Image pickup apparatus

ABSTRACT

An image pickup apparatus is disclosed which provides an appropriate inclination guide display in accordance with an aspect ratio of a picked-up image and the like. The image pickup apparatus includes an inclination detector which detects an inclination of the image pickup apparatus, a display device capable of superimposedly showing an inclination guide display corresponding to a detection output from the inclination detector, on a picked-up image, and an aspect ratio setter which sets the aspect ratio of a picked-up image. The apparatus includes a display controller which controls whether or not to show the inclination guide display on the display device on the basis of the aspect ratio set by the aspect ratio setter.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a Divisional of U.S. patent application Ser.No. 12/044,497 filed Mar. 7, 2008, which is a Continuation ofInternational Application No. PCT/JP2006/317651 filed Sep. 6, 2006 thatclaims priority from Japanese Patent Application No. 2005-261922 filedSep. 9, 2005, Japanese Patent Application No. 2005-313702 filed Oct. 28,2005, Japanese Patent Application No. 2005-313703 filed Oct. 28, 2005,Japanese Patent Application No. 2005-313704 filed Oct. 28, 2005,Japanese Patent Application No. 2005-367581 filed Dec. 21, 2005,Japanese Patent Application No. 2006-114885 filed Apr. 18, 2006,Japanese Patent Application No. 2006-167319 filed Jun. 16, 2006,Japanese Patent Application No. 2006-180206 filed Jun. 29, 2006,Japanese Patent Application No. 2006-184628 filed Jul. 4, 2006, andJapanese Patent Application No. 2006-237586 filed Sep. 1, 2006, theentire contents of each of which are hereby incorporated by reference.

TECHNICAL FIELD

The present invention relates to an image pickup apparatus capable ofsuperimposedly displaying an inclination guide on a picked-up image toenable image-pickup with the apparatus horizontally held.

BACKGROUND ART

To enable video images picked up with a video camera or the like to beseen comfortably, techniques for keeping the camera horizontal have beenproposed. For example, Japanese Patent Laid-Open No. 64-40824 disclosesthat a horizontally detector detects an inclination of the camera todisplay information corresponding to the detected inclination on adisplay device to notice and warn the user of the inclination of thecamera. Further, for the display of the inclination, a proposal has beenmade of, for example, a technique for displaying a horizontal referenceline and the inclination of the camera in different colors, and if theymatch, displaying them as a single line as disclosed in Japanese PatentLaid-Open No. 2002-271654.

DISCLOSURE OF THE INVENTION

An object of the present invention is to provide an image pickupapparatus that provides an appropriate inclination guide display inaccordance with an image pickup mode, the aspect ratio of a picked-upimage, the hand-jiggling condition of the image pickup apparatus, a zoomcondition, and the like.

According to an aspect, the present invention provides an image pickupapparatus including an inclination detector which detects an inclinationof the image pickup apparatus, a display device capable ofsuperimposedly showing an inclination guide display corresponding to adetection output from the inclination detector, on a picked-up image, anaspect ratio setter which sets the aspect ratio of a picked-up image,and a display controller which controls whether or not to show theinclination guide display on the display device on the basis of theaspect ratio set by the aspect ratio setter.

According to another aspect, the present invention provides an imagepickup apparatus including an inclination detector which detects aninclination of the image pickup apparatus, an aspect switcher whichswitches the aspect ratio of a picked-up image, and

a display controller which, if inclination information detected by theinclination detector indicates a predetermined value or larger,superimposedly shows an inclination guide display on a picked-up imagedisplayed on a display device. The display controller changes thepredetermined value in accordance with the aspect ratio.

According to another aspect, the present invention provides an imagepickup apparatus including an inclination detector which detects aninclination of the image pickup apparatus, an aspect switcher whichswitches the aspect ratio of a picked-up image, and a display controllerwhich, if the inclination information detected by the inclinationdetector indicates a predetermined value or larger, superimposedly showsan inclination guide display on a picked-up image displayed on a displaydevice. The display controller changes, when it shows the inclinationguide display, the display angle of the inclination guide displayrelative to the inclination detected by the inclination detector, inaccordance with the aspect ratio.

According to another aspect, the present invention provides an imagepickup apparatus including an inclination detector which detects aninclination of the image pickup apparatus, an aspect switcher whichswitches the aspect ratio of a picked-up image, and a display controllerwhich, if the inclination information detected by the inclinationdetector indicates a predetermined value or larger, superimposedly showsan inclination guide display on a picked-up image displayed on a displaydevice. Sensitivity of the inclination detector is changed in accordancewith the aspect ratio.

According to another aspect, the present invention provides an imagepickup apparatus including an inclination detector which detects aninclination of the image pickup apparatus, an aspect switcher whichswitches the aspect ratio of a picked-up image, and a display controllerwhich, if the inclination information detected by the inclinationdetector indicates a predetermined value or larger, superimposedly showsan inclination guide display on a picked-up image displayed on a displaydevice. The display controller changes the predetermined value inaccordance with the aspect ratio, and the display controller changes,when it shows the inclination guide display, the display angle of theinclination guide display relative to the inclination detected by theinclination detector, in accordance with the aspect ratio.

According to another aspect, the present invention provides an imagepickup apparatus including an inclination detector which detects aninclination of the image pickup apparatus, a display device capable ofsuperimposedly showing an inclination guide display corresponding to adetection output from the inclination detector, on a picked-up image, ashake detector which detects a shake of the image pickup apparatus, anda display controller which controls whether or not to cause the displaydevice to superimposedly show the inclination guide display on thepicked-up image, on the basis of the detection output from the shakedetector.

According to another aspect, the present invention provides an imagepickup apparatus including an inclination detector which detects aninclination of the image pickup apparatus, a display device capable ofsuperimposedly showing an inclination guide display corresponding to adetection output from the inclination detector, on a picked-up image,and a display controller which controls whether or not to cause thedisplay device to superimposedly show the inclination guide display onthe picked-up image, on the basis of a shake variation signal obtainedby a band limitation of a detection output from the inclinationdetector.

According to another aspect, the present invention provides an imagepickup apparatus including a display device which shows a picked-upimage, an inclination detector which detects an inclination of the imagepickup apparatus, a display processor which shows an inclination guidedisplay corresponding to the inclination detected by the inclinationdetector, on the display device, a shake detector which detects a shakeof the image pickup apparatus, and an exaggeration level changer whichchanges a level of exaggeration of the inclination guide display inaccordance with the shake detected by the shake detector.

According to another aspect, the present invention provides an imagepickup apparatus including a display device which displays a picked-upimage, an inclination detector which detects an inclination of the imagepickup apparatus, a display processor which shows an inclination guidedisplay corresponding to the inclination detected by the inclinationdetector, on the display device, a shake detector which detects a shakeof the image pickup apparatus, and a detection sensitivity changer whichchanges detection sensitivity of the inclination detector in accordancewith the shake detected by the shake detector.

According to another aspect, the present invention provides an imagepickup apparatus including an inclination detector which detects aninclination of the image pickup apparatus, a display device capable ofsuperimposedly showing an inclination guide display corresponding to adetection output from the inclination detector, on a picked-up image, astitch image-pickup mode switcher capable of switches at least between anormal image-pickup mode and a stitch image pickup mode in whichimage-pickup is performed a plural number of times and then a pluralpicked-up images are connected together, and a display controller whichcontrols such that the inclination guide display is shown in the stitchimage-pickup mode.

According to another aspect, the present invention provides an imagepickup apparatus including an image pickup mode setter which sets one ofa moving image pickup mode and a still image pickup mode, a displaydevice which displays a picked-up image, an inclination detector whichdetects an inclination of the image pickup apparatus, and a displayprocessor which shows an inclination guide display corresponding to theinclination detected by the inclination detector, on the display device.The display processor changes a display state of the inclination guidedisplay in accordance with the image pickup mode set by the image-pickupmode setter.

According to another aspect, the present invention provides an imagepickup apparatus including an image pickup mode setter which sets amoving image pickup mode and a still image pickup mode, a display devicewhich displays a picked-up image, an inclination detector which detectsan inclination of the image pickup apparatus, a display processor whichshows an inclination guide display corresponding to the inclinationdetected by the inclination detector, on the display device, and achanger which changes detection sensitivity of the inclination detectordepending on whether the moving image pickup mode or the still imagepickup mode is set.

According to an aspect, the present invention provides an image pickupapparatus including an image pickup mode setter capable of setting atleast a moving image pickup mode and a still image pickup mode, aninclination detector which detects an inclination of the image pickupapparatus, a display device which displays a picked-up image, and adisplay processor which shows an inclination guide display correspondingto the inclination detected by the inclination detector, on the displaydevice. The display processor controls whether or not to show theinclination guide display on the display device in accordance with theimage pickup mode set by the image pickup mode setter.

According to another aspect, the present invention provides an imagepickup apparatus including an image pickup mode setter which sets animage pickup mode, a display device which displays a picked-up image, aninclination detector which detects an inclination of the image pickupapparatus, a display processor which shows an inclination guide displaycorresponding to the inclination detected by the inclination detector,on the display device, and a display controller which switches whetheror not to show the inclination guide display in accordance with theinclination detected by the inclination detector and changes aninclination at which the inclination guide display is shown or notshown, in accordance with the image pickup mode set by the image pickupmode setter.

According to another aspect, the present invention provides an imagepickup apparatus including an image pickup mode setter which sets animage pickup mode, a display device which displays a picked-up image, aninclination detector which detects an inclination of the image pickupapparatus, a display processor which shows an inclination guide displayexaggerating the inclination detected by the inclination detector, onthe display device, and a display controller which changes a level ofexaggeration of the inclination guide display in accordance with theimage pickup mode set by the image pickup mode setter.

According to another aspect, the present invention provides an imagepickup apparatus including an image pickup mode setter which sets animage pickup mode, a display device which displays a picked-up image, aninclination detector which detects an inclination of the image pickupapparatus, a display processor which shows an inclination guide displaycorresponding to the inclination detected by the inclination detector,on the display device, and a detection sensitivity changer which changesdetection sensitivity of the inclination detector in accordance with theimage pickup mode set by the image pickup mode setter.

According to another aspect, the present invention provides an imagepickup apparatus including a display device which displays a picked-upimage, an inclination detector which detects an inclination of the imagepickup apparatus, an inclination guide display generator which generatesan inclination guide display corresponding to the inclination of theimage pickup apparatus detected by the inclination detector, and aswitcher which switches whether or not to show the inclination guidedisplay on the display device on the basis of the inclination of theimage pickup apparatus detected by the inclination detector. Aninclination at which the inclination guide display is shown or not shownis changed depending on a zoom position of the image pickup apparatus.

According to another aspect, the present invention provides an imagepickup apparatus including a display device which displays a picked-upimage, an inclination detector which detects an inclination of the imagepickup apparatus, and an inclination guide display generator whichgenerates an inclination guide display corresponding to the inclinationof the image pickup apparatus detected by the inclination detector. Theinclination guide display generator generates the inclination guidedisplay exaggerating the inclination of the image pickup apparatusdetected by the inclination detector, in accordance with a zoom positionof the image pickup apparatus.

According to another aspect, the present invention provides an imagepickup apparatus including a display device which displays a picked-upimage, an inclination detector which detects an inclination of the imagepickup apparatus, an inclination guide display generator which generatesan inclination guide display corresponding to the inclination of theimage pickup apparatus detected by the inclination detector, and adetection sensitivity changer which changes detection sensitivity of theinclination detector in accordance with a zoom position of the imagepickup apparatus.

According to another aspect, the present invention provides an imagepickup apparatus including a display device which displays a picked-upimage, an inclination detector which detects an inclination of the imagepickup apparatus, and a display controller which, when the inclinationdetected by the inclination detector is equal to or larger than a firstangle, controls such that an inclination guide display corresponding tothe inclination detected by the inclination detector is shown on thedisplay device, and when the inclination detected by the inclinationdetector is smaller than a second angle that is smaller than the firstangle, controls such that the inclination guide display is not shown onthe display device.

The other objects and features of the present invention will be apparentfrom embodiments described below with reference to the accompanyingdrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing the configuration of a circuit in avideo camera that is Embodiment 1 of the present invention;

FIG. 2 is a flowchart showing an inclination guide display operationperformed by the video camera that is Embodiment 1 of the presentinvention;

FIGS. 3A-1 to 3C-2 are diagrams showing an inclination sensor and itsoutput characteristics that is Embodiment 1 of the present invention;

FIG. 4 is a diagram showing the range of the inclination guide displaythat is Embodiment 1 of the present invention;

FIGS. 5A and 5B are diagrams illustrating how a display threshold isdetermined when aspect ratio is 16:9 or 4:3 that is Embodiment 1 of thepresent invention;

FIG. 6 is a flowchart showing an inclination guide display operationperformed by a video camera that is Embodiment 2 of the presentinvention;

FIGS. 7A and 7B are diagrams illustrating how a guide display isprovided when the aspect ratio is 16:9 or 4:3 that is Embodiment 2 ofthe present invention;

FIG. 8 is a block diagram of a circuit for an inclination guide displaysection of a video camera that is Embodiment 3 of the present invention;

FIG. 9 is a flowchart showing an inclination guide display operationperformed by a video camera that is Embodiment 3 of the presentinvention;

FIG. 10 is a circuit diagram showing, in detail, the circuitconfiguration of a variable gain amplifier in FIG. 8;

FIG. 11 is a flowchart showing an inclination guide display operationperformed by a video camera that is Embodiment 4 of the presentinvention;

FIG. 12 is a block diagram showing the configuration of a circuit in avideo camera that is Embodiment 5 of the present invention;

FIG. 13 is a flowchart showing the operation for guide display in thevideo camera that is Embodiment 5 of the present invention;

FIGS. 14A-1 to 14C-2 are diagrams showing an inclination sensor and itsoutput characteristics that is Embodiment 5 of the present invention;

FIGS. 15A and 15B are diagrams showing an inclination guide display thatis Embodiment 5 of the present invention;

FIG. 16 is a block diagram showing the configuration of a circuit in adigital camera that is Embodiment 6 of the present invention;

FIG. 17 is a flowchart showing the operation for a stitch guide displayand a guide display performed by a digital camera that is Embodiment 5of the present invention;

FIGS. 18A to 18C are diagrams illustrating an example of display that isEmbodiment 6 of the present invention;

FIG. 19 is a block diagram showing the configuration of a circuit in animage pickup apparatus that is Embodiment 7 of the present invention;

FIGS. 20A to 20D are diagrams showing an inclination detection sensor inFIG. 19 and its output characteristics;

FIG. 21 is a diagram showing a picked-up image superimposed on a displaydevice in FIG. 19 and a guide display;

FIGS. 22A and 22B are diagrams showing shake signals obtained when thecamera is held by a user's hand and when the camera is fixed with atripod or the like that is Embodiment 7 of the present invention;

FIG. 23 is a flowchart showing an inclination guide display operationthat is Embodiment 7 of the present invention;

FIG. 24 is a block diagram showing the configuration of a circuit in animage pickup apparatus that is Embodiment 8 of the present invention;

FIGS. 25A to 25C are diagrams showing an inclination detection sensor inFIG. 24 and its output characteristics;

FIG. 26 is a flowchart showing an inclination guide display operationthat is Embodiment 8 of the present invention;

FIG. 27 is a block diagram showing the configuration of a circuit in animage pickup apparatus that is Embodiment 9 of the present invention;

FIG. 28 is a flowchart showing an inclination guide display operationthat is Embodiment 9 of the present invention;

FIG. 29 is a block diagram showing the outlined configuration of a videocamera that is Embodiment 10;

FIG. 30 is a flowchart illustrating the processing operation performedby a microcomputer that is Embodiment 10;

FIGS. 31A to 31C are diagrams showing the relationship between theinclination of the video camera and an output from the inclinationdetection sensor;

FIG. 32 is a diagram showing the range of a guide display on a displaydevice;

FIGS. 33A and 33B are diagrams showing shake detection signals obtainedwhen the video camera is held by the user's hand and when the camera isfixed with a tripod or the like;

FIG. 34 is a flowchart illustrating the processing operation performedby the microcomputer that is Embodiment 11;

FIGS. 35A and 35B are diagrams showing a guide display obtained whendisplay sensitivity is changed that is Embodiment 11;

FIG. 36 is a block diagram showing the outlined configuration of a partof a video camera that is Embodiment 12;

FIG. 37 is a flowchart illustrating the processing operation performedby the microcomputer that is Embodiment 12;

FIG. 38 is a diagram showing an example of a variable gain amplifiercircuit;

FIG. 39 is a flowchart illustrating the processing operation performedby the microcomputer that is Embodiment 13;

FIG. 40 is a block diagram showing the outlined configuration of a videocamera that is Embodiment 14;

FIGS. 41A to 41C are diagrams showing the relationship between theinclination of the video camera and an output from the inclinationsensor;

FIG. 42 is a flowchart illustrating the processing operation performedby a camera system controlling microcomputer that is Embodiment 14;

FIG. 43 is a diagram showing how an inclination guide display isprovided on a display device;

FIG. 44 is a flowchart illustrating the processing operation performedby a camera system controlling microcomputer that is Embodiment 15;

FIG. 45 is a block diagram showing the outlined configuration of a videocamera that is Embodiment 16;

FIG. 46 is a flowchart illustrating the processing operation performedby a camera system controlling microcomputer that is Embodiment 16;

FIG. 47 is a diagram showing an example of configuration of a variablegain amplifier circuit at is Embodiment 16;

FIG. 48 is a flowchart illustrating the processing operation performedby a camera system controlling microcomputer that is Embodiment 17;

FIG. 49 is a diagram showing an example of configuration of a variablegain amplifier circuit that is Embodiment 17;

FIG. 50 is a block diagram showing the configuration of a video camerathat is Embodiment 18 of the present invention;

FIG. 51 is a flowchart illustrating the operation performed by the videocamera that is Embodiment 18 of the present invention;

FIGS. 52A to 52C are diagrams illustrating an inclination sensor for avideo camera that is a first embodiment of the present invention;

FIG. 53 is a diagram showing a display example of an inclination guidedisplay in the video camera that is Embodiment 18 of the presentinvention;

FIG. 54 is a block diagram showing the configuration of a video camerathat is Embodiment 19 of the present invention;

FIG. 55 is a flowchart illustrating the operation performed by the videocamera that is Embodiment 19 of the present invention;

FIGS. 56A and 56B are diagrams showing a display example of aninclination guide display in the video camera that is Embodiment 19 ofthe present invention;

FIG. 57 is a block diagram showing the configuration of a video camerathat is Embodiment 20 of the present invention;

FIG. 58 is a flowchart illustrating the operation performed by the videocamera that is Embodiment 20 of the present invention;

FIG. 59 is a diagram showing a display example of an inclination guidedisplay in the video camera that is Embodiment 20 of the presentinvention;

FIG. 60 is a block diagram showing the configuration of the video camerathat is Embodiment 20 of the present invention;

FIG. 61 is a flowchart illustrating the operation performed by the videocamera that is Embodiment 21 of the present invention;

FIG. 62 is a block diagram showing the configuration of a circuit in avideo camera that is Embodiment 22 of the present invention;

FIGS. 63A to 63D are diagrams showing an inclination sensor and itsoutput characteristics that is Embodiment 22 of the present invention;

FIG. 64 is a flowchart showing the operation associated with aninclination guide display that is Embodiment 22 of the presentinvention;

FIG. 65 is a diagram showing an example of an inclination guide displaythat is Embodiment 22 of the present invention;

FIG. 66 is a flowchart showing the operation associated with aninclination guide display that is Embodiment 23 of the presentinvention;

FIG. 67 is a schematic block diagram showing the system configuration ofan image pickup apparatus that is Embodiment 24 of the presentinvention;

FIG. 68 is a flowchart illustrating an operation for controlling adisplay controlling part shown in FIG. 67;

FIG. 69 is a graph showing the relationship between the inclination ofthe image pickup apparatus shown in FIG. 67 and an inclination sensor(acceleration sensor);

FIGS. 70A and 70B are diagrams schematically showing the range of aguide display on a display device shown in FIG. 67;

FIG. 71 is a flowchart illustrating another control operation performedby the display controlling part shown in FIG. 67;

FIG. 72 is a flowchart illustrating another control operation performedby the display controlling part shown in FIG. 67;

FIG. 73 is a schematic block diagram showing an example of configurationof detector of the image pickup apparatus shown in FIG. 67;

FIG. 74 is a schematic block diagram showing the configuration of avariable gain amplifier shown in FIG. 73;

FIG. 75 is a flowchart illustrating another control operation performedby a display controlling part shown in FIG. 73;

FIG. 76 is a block diagram showing the outlined configuration of a videocamera that is Embodiment 25;

FIGS. 77A-1 to 77A-3 are diagrams showing the relationship between theinclination of the video camera and an output from an inclinationsensor;

FIG. 77B is a diagram showing the relationship between the inclinationof the video camera and an output from the inclination sensor;

FIG. 78 is a flowchart illustrating the processing operation performedby the video camera that is Embodiment 25;

FIGS. 79A and 79B are diagrams showing how an inclination guide displayis provided on a display device;

FIG. 80 is a flowchart illustrating the processing operation performedby a video camera that is Embodiment 26;

FIG. 81 is a block diagram showing a part of outlined configuration of avideo camera that is Embodiment 27;

FIG. 82 is a flowchart illustrating the processing operation performedby a video camera that is Embodiment 27;

FIGS. 83A and 83B are diagrams showing how an inclination guide displayis provided on a display device;

FIG. 84 is a diagram showing an example of configuration of a variablegain amplifier circuit that is Embodiment 27;

FIG. 85 is a flowchart illustrating the processing operation performedby a video camera that is Embodiment 28;

FIG. 86 is a diagram illustrating the configuration of a video camerathat is Embodiment 29 of the present invention;

FIG. 87 is a diagram illustrating the flow of the operation performed bythe video camera that is Embodiment 29;

FIG. 88 is a diagram showing a display example of an inclination guidedisplay;

FIG. 89 is a diagram showing how an inclination guide display isprovided;

FIGS. 90A-1 to 90A-3 and 90B are diagrams showing the outputcharacteristics of an inclination sensor with respect to the inclinationof the video camera;

FIG. 91 is a diagram illustrating the flow of the operation performed bya video camera that is Embodiment 30; and

FIG. 92 is a diagram illustrating the configuration of the video camerathat is Embodiment 30.

BEST MODE FOR CARRYING OUT THE INVENTION

Preferred embodiments of the present invention will be described belowwith reference to the drawings.

Embodiment 1

FIG. 1 is a block diagram showing the configuration of a circuit in avideo camera that is Embodiment 1 of the present invention. In FIG. 1,reference numeral 101 denotes a lens unit used to pick up an image of anobject. Reference numeral 102 denotes a CCD (Charge-Coupled Device) thatphotoelectrically converts an image of the object formed by the lensunit 101 into a signal. Reference numeral 103 denotes an analog signalprocessing part that executes predetermined processing on the signalobtained by the CCD 102 to generate an analog image pickup signal. Theanalog signal processing part 103 is constituted by, for example, a CDS(Co-related Double Sampling) circuit, an AGC (Automatic Gain Control)circuit, and the like. Reference numeral 104 denotes a camera signalprocessing part that uses a built-in A/D converter to convert an analogimage pickup signal into a digital signal and that executespredetermined signal processing such as gamma correction and whitebalancing on the signal to generate a final output video signal.

Reference numeral 107 denotes an inclination sensor to detect aninclination of the video camera, which is an acceleration sensor inEmbodiment 1. Reference numeral 108 denotes an amplifier that amplifiesan output from the inclination sensor 107 (sensor output). Referencenumeral 109 is a camera controlling microcomputer constituted by adisplay controlling part 110 and a camera controlling part 111. Thecamera controlling part 111 controls the drive of the CCD 102, analogsignal processing part 103, and camera signal processing part 104. Thedisplay controlling part 110 loads an output from the amplifier 108 anddetermines whether or not to provide a display corresponding to theinclination on the basis of the detected inclination information tooutput display control information to a guide display setting part 112.The guide display setting part 112 outputs information on a guidedisplay corresponding to the inclination to a display processing circuit105. The display processing circuit 105 superimposes the guide displayinformation on the output video signal to enable a display device 106such as a viewfinder or a liquid crystal panel to display the resultingimage.

Reference numeral 113 denotes a switch for an aspect ratio. A User canuse this switch 113 to switch the aspect ratio between 4:3 and 16:9.When switching the aspect ratio, the camera controlling part 111 setsrespective processing parts.

FIG. 2 is a flowchart showing the operation performed by the displaycontrolling part 110 in the camera controlling microcomputer 109.

First, in step S201, inclination information is loaded from theinclination sensor 107 via the amplifier 108. In next step S202, theprocess determines whether or not the current image pickup angle of view(aspect ratio) is 4:3 or 16:9, on the basis of the state of the switch113. As a result, if the aspect ratio is not 16:9, the process proceedsto step S203. In step S203, the process determines whether or not thecurrent inclination of the video camera is equal to or larger than apredetermined value α. If the inclination is equal to or larger than thepredetermined value α, the process proceeds to step S204 to turn on theguide display. On the other hand, if the inclination is smaller than thepredetermined value α, the process proceeds to step S207 to turn off theguide display.

If the image pickup angle of view is determined to be 16:9 in step S202,the process proceeds to step S206 to determine whether or not theinclination of the video camera is equal to or larger than apredetermined value β. If the inclination is equal to or larger than thepredetermined value P, the process proceeds to step S204 to turn on theguide display. On the other hand, if the inclination is smaller than thepredetermined value P, the process proceeds to step S207 to turn off theguide display. In step S205 and step S208, inclination data is set anddisplay information is instructed, respectively.

The relationship between the predetermined values α and β is:

>β.

The inclination at which the guide display is turned on is smaller for16:9 than for 4:3. Thus, for 16:9, with which the inclination of thevideo camera is more noticeable, the guide display is provided at thesmaller inclination.

FIGS. 3A-1 to 3C-2 are diagrams showing the relationship between theinclination of the video camera and an output from the inclinationsensor 107. In FIGS. 3A-1 to 3C-1, reference numerals 100, 106, and 107denote the video camera, the display device that is a liquid crystalpanel, and the inclination sensor (acceleration sensor), respectively.

Appropriate setting of the gain of the amplifier 108 in FIG. 1 enables asensor output from the inclination sensor 107 to be set to have thevoltage range described below.

FIG. 3B-1 shows that the video camera 100 is located at a regularposition. The sensor output is half of a power supply voltage as shownin FIG. 3B-2. In contrast, inclining the video camera 100counterclockwise by 90° as shown in FIG. 3A-1 provides a sensor outputequal to the power supply voltage as shown in FIG. 3A-2. In contrast,inclining the video camera 100 clockwise by 90° as shown in FIG. 3C-1provides a sensor output at a GND level as shown in FIG. 3C-2.

For the inclinations between those shown in FIG. 3A-1 and FIG. 3B-1 orbetween those shown in FIG. 3B-1 and FIG. 3C-1, the sensor outputchanges linearly with the inclination. Thus, setting a predeterminedvoltage threshold for an output obtained at the regular position shownin FIG. 3B-2 makes it possible to determine whether or not apredetermined angle is reached. That is, switching the voltage thresholdfor the sensor output between 16:9 and 4:3 enables the setting of theangle at which the inclination guide display is turned on.

Reversing the orientation of the inclination sensor 107 reverses thevoltage of the sensor output obtained when the video camera 100 isinclined with respect to that shown in FIGS. 3A-2 and 3C-2.

FIG. 4 shows the range of the inclination guide display on the displaydevice 106 such as a liquid crystal panel or a viewfinder. As describedabove, switching the voltage threshold of the sensor output for displaybetween 16:9 and 4:3 makes the area in which the inclination guidedisplay is turned off smaller for the aspect ratio of 16:9 than for theaspect ratio of 4:3. This enables the inclination of the video camera tobe more quickly determined for the aspect ratio of 16:9.

FIGS. 5A and 5B show an example of how the voltage threshold of thesensor output for the inclination guide display is determined for theaspect ratios of 16:9 and 4:3.

In FIGS. 5A and 5B, when a guide display A-B is defined as a horizontalreference for the aspect ratio of 16:9 and a guide display A′-B′ isdefined as a horizontal reference for the aspect ratio of 4:3, theangles at which the differences in height between points A and B andbetween points A′ and B′, resulting from the inclination of the videocamera, are equal to the same width X are defined as inclinations atwhich the guide display corresponding to the inclination is turned onfor the aspect ratios of “16:9” and “4:3”. This setting makes thedifference in inclination between the display with 16:9 and the displaywith 4:3 unnoticeable. Further, this setting makes it possible toprovide the guide display for the aspect ratio of 16:9 at a smallerinclination of the video camera than for the aspect ratio of 4:3. Thisenables the user to be quickly noticed of the inclination of the videocamera.

According to Embodiment 1, when the guide display relating to theinclination of the video camera 100 is provided on the display device106, the inclination at which the guide display is provided is switchedbetween the aspect ratio of 16:9 and the aspect ratio of 4:3.Specifically, the inclination at which the guide display is provided isset smaller for image pickup in the aspect ratio of 16:9, with which theinclination is more noticeable. This enables the user to be quicklynoticed of the inclination of the video camera and also enablesimprovement of horizontal accuracy of the video camera.

Embodiment 2

Next, Embodiment 2 of the present invention will be described. Theconfiguration of a circuit in the video camera that is Embodiment 2 ofthe present invention is similar to that in Embodiment 1 except for theoperation in the camera controlling microcomputer 109.

FIG. 6 is a flowchart showing the operation performed by the displaycontrolling part 110 in the camera controlling microcomputer 109. First,in step S601, inclination information is loaded from the inclinationsensor 107 via the amplifier 108. Then, in next step S602, the processdetermines whether or not the detected inclination is equal to or largerthan a predetermined If the inclination is determined to be equal to orlarger than the predetermined value α, the process proceeds to step S603to make settings required to turn on a guide display. In next step S604,the process determines whether or not the current aspect ratio is 16:9.If the aspect ratio is determined to be 16:9, the process proceeds tostep S605 to exaggeratedly set a display angle. This is an operation forexaggerating the displayed inclination compared to the actualinclination. If the aspect ratio is determined not to be 16:9, theprocess proceeds from step S604 to step S606 to set the display angle ata normal value. Subsequently, in both cases, the process proceeds tostep S608 to provide display information instruction to the guidedisplay setting part 112 for causing the display device 106 to show theguide display.

FIGS. 7A and 7B are diagrams showing the guide display (inclinationguide display) corresponding to the inclination when the abovesensitivity is changed in Embodiment 2. These figures indicates thateven with the same inclination of the video camera from the horizontalposition, selecting 16:9 enables the inclination guide display to beexaggeratedly displayed compared to selecting 4:3.

Exaggeration of the inclination guide display for the aspect ratio of16:9 enables the inclination of the video camera to be more clearlyshown; the user can easily recognize the inclination. Further,increasing the display angle for the aspect ratio of 16:9 enables avariation in inclination resulting from a slight movement to be easilyrecognized. This enables the video camera to be more easily sethorizontal.

Referring back to FIG. 6, when the video camera 100 is set horizontal,in step S602 in FIG. 6 the inclination becomes smaller than thepredetermined value α, and then the process proceeds to step S607. Instep S607, the guide display is set to be turned off. In subsequent stepS608, the guide display setting part 112 is instructed to turn off thedisplay, thus turning off the guide display on the display device 106.

According to Embodiment 2, the display angle is set larger for theaspect ratio of 16:9 than for the aspect ratio of 4:3. Thus, when imagepickup is carried out with the aspect ratio of 16:9, with which theinclination of the image pickup result is more noticeable, it ispossible to notice the user of the inclination of the video camera in aneasier-to-understand manner.

Moreover, the amount of movement of the video camera in response to itsslight inclination can be clearly determined, enabling the video camerato be more easily set horizontal.

Embodiment 3

FIG. 8 is a block diagram showing the circuit configuration of essentialparts of a video camera that is Embodiment 3 of the present invention.In FIG. 8, components having the same functions as those in FIG. 1 aredenoted by the same reference numerals and their description is omitted.

In FIG. 8, reference numeral 701 denotes a variable gain amplifier thatcan change the gain of the inclination sensor 107. In accordance withthe setting of the switch 113, which switches the aspect ratio, a gaincontrolling part 703 provided in the camera controlling microcomputer702 controls the variable gain amplifier 701 to change the gain.

FIG. 9 is a flowchart showing the operation for the guide displaycontrol in the camera controlling microcomputer 702.

First, in step S801, inclination information is loaded from theinclination sensor 107. In next step S802, the process determineswhether or not the current aspect ratio is 16:9. If the aspect ratio is16:9, the process proceeds to step S803 to check whether or not sensorsensitivity is set higher. That is, the process determines whether ornot the gain of the variable gain amplifier 701 is set higher. If thegain is not set higher, the process proceeds to step S808 to makesettings for increasing the gain (sensor sensitivity).

FIG. 10 is a diagram showing the detailed circuit configuration of thevariable gain amplifier 701. The variable gain amplifier 701 isconstituted by an amplifier 705, resistors 706, and a gain switch 704. Aswitch signal from the camera controlling microcomputer 702 for the gainswitch 704 connects input resistors in parallel with each other withrespect to the amplifier 705 to increase the amplifier gain. The gainchange is effected to exaggerate the inclination in the guide displayfor the aspect ratio of 16:9 compared to the actual inclination.

Referring back to FIG. 9, if the process determines in step S803 thatthe sensor gain is set higher, it proceeds to step S804 to determinewhether or not the detected inclination information is equal to orlarger than a predetermined If the inclination is equal to or largerthan the predetermined value α, the process proceeds to step S805 tomake settings for turning on the guide display. In next step S806,display information instruction is provided to the guide display settingpart 112 for causing the display device 106 to show the guide display.

If the process determines in step S802 that the aspect ratio is 4:3, itproceeds to step S809 to check whether or not the sensor sensitivity isset at the normal value. If the sensor sensitivity is not set at thenormal value, that is, it is set at a value for the aspect ratio of16:9, the process proceeds to step S810 to set the sensor sensitivity tothe normal value. This is an operation for turning off the gain switch704 in the variable gain amplifier 701.

If the process determines in step S809 that the sensor sensitivity isset at the normal value, a process is executed similarly to step S804and subsequent steps for the aspect ratio of 16:9.

Regardless of whether the aspect ratio is 16:9 or 4:3, upon determiningin step S804 that the inclination is smaller than the predeterminedvalue α, the process proceeds to step S807 to make settings for turningoff the guide display. In next step S806, the guide display setting part112 is instructed to turn off the display. Consequently, the guidedisplay on the display device 106 is turned off.

According to Embodiment 3, if the aspect ratio is set at 16:9, settingthe gain of the variable gain amplifier 701 higher than for the aspectratio of 4:3 provides the same results as those in Embodiment 2. Thus,when image pickup is carried out with the aspect ratio of 16:9, withwhich the inclination of the image pickup result is more noticeable, itis possible to notice the user of the inclination of the video camera inan easier-to-understand manner.

Moreover, the amount of movement of the video camera in response to itsslight inclination can be clearly determined, enabling the video camerato be more easily set horizontal.

Embodiment 4

FIG. 11 is a flowchart showing the operation for the guide display forthe inclination, the operation being performed in a camera controllingmicrocomputer of a video camera that is Embodiment 4 of the presentinvention.

Embodiment 4 of the present invention is an example of combination ofEmbodiments 1 and 2, described above. The configuration of a circuit inthe video camera is the same as that in FIG. 1. In Embodiment 4, theinclination of the video camera at which the guide display is providedis changed between the aspect ratio of 16:9 and the aspect ratio of 4:3.Further, the display angle is increased for the aspect ratio of 16:9 inorder to display the exaggerated inclination.

With reference to the flowchart in FIG. 11, description will be given ofthe operation for the guide display in Embodiment 4 of the presentinvention.

First, in step S1101, inclination information is loaded from theinclination sensor 107 via the amplifier 108. In next step S1102, theprocess determines whether or not the current image pickup angle of viewis equal to the aspect ratio of 16:9 or 4:3. If the angle of view isdetermined to be equal to the aspect ratio of 16:9, the process proceedsto step S1103 to determine whether or not the inclination of the videocamera is equal to or larger than a predetermined value β, on the basisof the loaded inclination information. If the inclination is equal to orlarger than the predetermined value β, the process proceeds to stepS1104 to turn on the guide display and to further increase the displayangle. In next step S1105, display information instruction is providedto the guide display setting part 112 for causing the display device 106to show the guide display.

If the process determines in step S1102 that the aspect ratio is 4:3, itproceeds to step S106 to determine whether or not the loaded inclinationinformation is equal to or larger than a predetermined value α. If theinclination is equal to or larger than the predetermined value α, theprocess proceeds to step S1107 to make settings for turning on the guidedisplay, while executing a process to set the normal display angle.Subsequently, as in the case of the aspect ratio of 16:9, in the stepS1105, display information instruction is provided to the guide displaysetting part 112 for causing the display device 106 to show the guidedisplay.

If the aspect ratio is 16:9 and the process determines in step S1103that the inclination is smaller than the predetermined value β or if theaspect ratio is 4:3 and the process determines in step S1106 that theinclination is smaller than the predetermined value α, then the videocamera is almost horizontal. Thus, in both cases, the process proceedsto step S1108 to make settings for turning off the guide display. Innext step S1105, display information instruction is provided to theguide display setting part 112. Consequently, the guide display on thedisplay device 106 is turned off.

The relationship between the predetermined values α and β is set to be:

>display angle magnification×β

That is, in FIG. 5A, described above, the vertical distance X betweenthe guide display points A and B provided with the aspect ratio of 16:9when the video camera is inclined involves the display anglemagnification. Thus, the inclination at which the guide display isturned on is always smaller for the aspect ratio of 16:9 than for theaspect ratio of 4:3. The guide display for the aspect ratio of 16:9 ismore significantly exaggerated as the inclination of the cameraincreases.

According to Embodiment 4, with the aspect ratio of 16:9, with which theinclination is more noticeable, the guide display is provided at asmaller inclination. This enables the user to be quickly noticed of theinclination of the camera. Further, an exaggerated guide display of theactual inclination is provided for a larger inclination, enabling theinclination of the camera to be more clearly recognized.

This also enables a variation in inclination resulting from a slightmovement to be easily recognized. Thus, the video camera can be moreeasily set horizontal, enabling improvement of the horizontal accuracy.

In Embodiments 1 to 4, the inclination at which the guide display isprovided when the video camera is inclined is changed depending on theaspect ratio. Consequently, even with a horizontally long image that islikely to be significantly affected by the inclination of the videocamera, Embodiments 1 to 4 can urge the user to make the inclination ofthe camera unnoticeable. This prevents the user from viewing unsightlyimages.

In Embodiments 1 to 4, the aspect ratio can be switched only between16:9 and 4:3. However, the present invention is not limited thereto butis applicable to any image sizes with various aspect ratios, such as acinema scope size.

Embodiment 5

FIG. 12 is a block diagram showing the configuration of a circuit in avideo camera that is Embodiment 5 of the present invention. In FIG. 12,reference numeral 1101 denotes a lens unit used to pick up an image ofan object. Reference numeral 1102 denotes a CCD that photoelectricallyconverts an image of the object formed by the lens unit 1101 into ananalog picked-up image signal. Reference numeral 1103 denotes a signalprocessing circuit that uses a built-in A/D converter to convert theanalog picked-up image of the object obtained by the CCD 1102 into adigital signal. The signal processing circuit 1103 then executespredetermined signal processing such as gamma correction and whitebalancing on the digital signal to generate a standard video signal suchas an NTSC.

Reference numeral 1104 denotes an aspect ratio switch operated by theuser in accordance with the conditions of image pickup to switch theaspect ratio. Reference numeral 1105 denotes an inclination sensor thatdetects information on the inclination of the video camera; inEmbodiment 5, an acceleration sensor is used for the inclination sensor.Reference numeral 1106 denotes an amplifier that amplifies an outputfrom the inclination sensor 1105. Reference numeral 1107 denotes a guidedisplay signal generating circuit that generates a guide display signal(inclination guide display signal) in accordance with the inclinationinformation. Reference numeral 1108 denotes a display superimposingcircuit that can display an image obtained by synthesizing a standardvideo signal obtained by the signal processing circuit 1103 with theguide display signal obtained by the guide display signal generatingcircuit 1107 (that is, an image obtained by superimposing a guidedisplay (inclination guide display) on a picked-up image). Referencenumeral 1109 denotes a microcomputer that controls the drive of the CCD1102 and signal processing circuit 1103 and that controls the aspectratio of the picked-up image and the operation of the displaysuperimposing circuit 1108.

Reference numeral 1110 denotes a viewfinder that can display the imageobtained by synthesizing the standard video signal with the guidedisplay signal. Reference numeral 1111 denotes a recorder that recordsthe standard video signal processed by the signal processing circuit1103 as a picked-up image.

In the above configuration, an image of the object picked up via thelens unit 1101 is formed on the CCD 1102, which photoelectricallyconverts the image of the object into a signal. The signal processingcircuit 1103 subsequently converts the signal from the CCD 1102 into adigital signal. The signal is then subjected to predetermined signalprocessing such as gamma correction and white balancing to become astandard video signal. The standard video signal is output to a recorder1111, which records the signal as a picked-up image. The standard videosignal is also output to the display superimposing circuit 1108.

On the other hand, the inclination information obtained by theinclination sensor 1105 is amplified to a predetermined amount by theamplifier 1106. The guide display signal generating circuit 1107 outputsthe resulting guide display signal corresponding to the inclinationinformation to the display superimposing circuit 1108. Thus, the imageobtained by the display superimposing circuit 1108 by superimposing theguide display signal on the standard video signal is output to theviewfinder 1110. Then, on the viewfinder 1110, the guide display (whichwill be described later in detail with reference to FIG. 15) issuperimposed on the picked-up image to enable the video camera to beheld horizontal for image pickup.

Next, switching of the aspect ratio will be described. For example, itis assumed that with the video camera using the CCD with an aspect ratioof 16:9, the user operates the aspect switch 1104 to switch the aspectratio from 16:9 to 4:3. This operation generates a switching signal fromthe aspect switch 1104 to be input to the microcomputer 1109. Then, themicrocomputer 1109 instructs the CCD 1102 and signal processing circuit1103 to read and process signals at the timing of change of the aspectratio. Specifically, a picked-up image with a desired aspect ratio isobtained by preventing reading of signals from part of the image area ofthe CCD 1102. The mechanism of switching of the aspect ratio is notdirectly related to the present invention, and its detailed descriptionis thus omitted. In the present embodiment, the aspect ratio is definedas a ratio that can be expressed by the size in the horizontaldirection/the size in the vertical direction.

Further, in response to switching of the aspect ratio via the aspectratio switch 1104, the microcomputer 1109 outputs a displaysuperimposition control signal to the display superimposing circuit1108. The display superimposing circuit 1108 permits or prohibits thesynthesis of the guide display signal input from the guide displaysignal generating circuit 1107 with the standard video signal obtainedby the signal processing circuit 1103, in accordance with the displaysuperimposition control signal. For example, if the aspect ratio isswitched to a smaller value, 4:3, the synthesis of the guide displaysignal with the standard video signal is prohibited. In contrast, if theaspect ratio is switched to a larger value, 16:9, the synthesis of theguide display signal with the standard video signal is permitted.

Next, processing executed by the microcomputer 1109 will be describedwith reference to FIG. 13. FIG. 13 is a flowchart showing the operationof the microcomputer 1109 for the guide display associated withswitching of the aspect ratio.

The flowchart is repeatedly implemented at a predetermined period, forexample, on the basis of video synchronization. The operation is startedat step S1201, and in step S1202, the state of switching of the aspectratio via the aspect ratio switch 1104 is checked. As a result, if theaspect ratio has been switched to 4:3, the process proceeds to stepS1203. If the aspect ratio has been switched to 16:9, the processproceeds to step S1207.

First, description will be given of the case where the aspect ratio hasbeen switched to 4:3. In this case, the process proceeds from step S1202to step S1203 to set a 4:3 read area for the CCD 1102. In next stepS1204, signal processing by the signal processing circuit 1103 is set soas to correspond to the aspect ratio of 4:3. Specifically, imageprocessing is executed which corresponds to the number of scan linesread from the CCD 1102. In subsequent step S1205, the displaysuperimposing circuit 1108 is prohibited from performing a superimposingoperation in order to prohibit the guide display. This causes only thestandard video signal to be output to the viewfinder 1110, which thusdisplays only the picked-up image.

Further, if the process determines in step S1202 that the aspect ratiohas been switched to 16:9, it proceeds to step S1207 to set a 16:9 readarea for the CCD 1102. In next step S1208, signal processing by thesignal processing circuit 1103 is set so as to correspond to the aspectratio of 16:9. Specifically, image processing is executed whichcorresponds to the number of scan lines read from the CCD 1102. Insubsequent step S1209, the display superimposing circuit 1108 performs asuperimposing operation in order to permit the guide display. Thisenables a signal obtained by synthesizing the standard video signal withthe guide display signal to be output to the viewfinder 1110, which thusshows the guide display superimposed on the picked-up image.

After finishing the operation in step S1205 or S1209, the processproceeds to step S1206 to finish the flow.

FIGS. 14A-1 to 14C-2 are diagrams showing the relationship between theinclination of the video camera and an output from the inclinationsensor 1105. In FIGS. 14A-1 to 14C-1, reference numerals 1100, 1110, and1105 denote the video camera, the display device that is a liquidcrystal panel, and the inclination sensor (acceleration sensor),respectively.

Appropriate setting of the gain of the amplifier 1106 in FIG. 12 enablesa sensor output from the inclination sensor 1105 to be set to have thevoltage range described below.

FIG. 14B-1 shows that the video camera 1100 is located at a regularposition. The sensor output is half of a power supply voltage Vcc asshown in FIG. 14B-2. In contrast, inclining the video camera 1100counterclockwise by 90° as shown in FIG. 14A-1 provides a sensor outputequal to the power supply voltage Vcc as shown in FIG. 14A-2. Further,inclining the video camera 1100 clockwise by 90° as shown in FIG. 14C-1provides a sensor output at a GND level as shown in FIG. 14C-2.

For the inclinations between those shown in FIG. 14A-1 and FIG. 14B-1and between those shown in FIG. 14B-1 and FIG. 14C-1, the sensor outputchanges linearly with the inclination. On the basis of the voltagecorresponding to the inclination, the guide display signal generatingcircuit 1107 generates the guide display signal indicating theinclination amount. The display superimposing circuit 1108 thensynthesizes the guide display signal with the standard video signal, andthe resulting signal is displayed on the viewfinder 1110.

Next, an image displayed on the viewfinder 1110 will be described withreference to FIGS. 15A and 15B.

FIG. 15A shows an image on the viewfinder 1110 obtained when the aspectratio is switched to 4:3. In this case, a 4:3 picked-up image isdisplayed on the viewfinder 1110. Further, FIG. 15B shows an image onthe viewfinder 1110 obtained when the aspect ratio is switched to 16:9.In this case, the display superimposing circuit 1108 synthesizes thestandard video signal with the guide display signal generated by theguide display signal generating circuit 1107. Consequently, the guidedisplay 1301 with an inclination 1302 is superimposedly displayed on thepicked-up image shown on the viewfinder 1110. The gain of the amplifier1106, which amplifies the output from the inclination sensor 1105, canbe adjustably set equivalent to the inclination of the object (forexample, the inclination of the horizon or the like in the background).

Further, FIG. 15A and FIG. 15B show the difference in display positionbetween the laterally opposite ends of an image observed when the videcamera is inclined by the same inclination amount. As shown in thesefigures, with a horizontal line (the horizon or the like) crossing thescreen in the lateral direction as shown in the figures, the differenceB in display position for the aspect ratio of 16:9 is larger than thedifference A in display position for the aspect ratio of 4:3. That is,even with the same inclination, effects on the picked-up image changedepending on the aspect ratio; the level of the effect increasesconsistently with the aspect ratio.

Embodiment 5 has been described in conjunction with a change in theaspect ratio of the video camera. However, the description also appliesto still cameras or the like. A process similar to that in the presentembodiment can be executed when an aspect ratio of 3:2 and an aspectratio for panoramic image pickup are switched.

According to Embodiment 5, if the process determines that the currentaspect ratio is equal to or lower than the predetermined value, itprohibits the guide display 1301 from being superimposedly shown on thepicked-up image shown on the viewfinder 1110. Further, if the processdetermines that the current aspect ratio is higher than thepredetermined value (in this case, the aspect ratio is 16:9), it permitsthe guide display 1301 to be superimposedly shown on the picked-up imageshown on the viewfinder 1110.

Consequently, even with a horizontally long picked-up image that islikely to be significantly affected by the inclination of the camera, itis possible to urge the user to make the inclination of the cameraunnoticeable. This avoids making the image unsightly.

Embodiment 6

Next, a digital camera that is Embodiment 6 will be described.Embodiment 5 described above enables switching to the horizontally longaspect ratio. Embodiment 6 of the present invention has an image pickupmode in which a plurality of still images that form an angle of viewextending in the horizontal direction can be picked up. This imagepickup mode enables what is called stitch image pickup by whichsynthesizing image processing is executed on the images to obtain asingle horizontally joined still image. A guide display is provided forthe stitch image pickup.

FIG. 16 is a block diagram showing the configuration of a circuit in thedigital camera that is Embodiment 6 of the present invention. In FIG.16, reference numeral 1401 denotes a lens unit used to pick up an imageof an object. Reference numeral 1402 denotes a CCD thatphotoelectrically converts an image of the object formed by the lensunit 401. Reference numeral 1403 denotes a signal processing circuitthat uses a built-in A/D converter to convert the analog picked-up imageof the object obtained by the CCD 1402 into a digital signal. The signalprocessing circuit 1403 then executes predetermined signal processingsuch as gamma correction and white balancing on the digital signal togenerate a still image signal. Reference numeral 1404 denotes an imagememory that stores the picked-up still image signal.

Reference numeral 1405 denotes an inclination sensor that detectsinformation on the inclination of the video camera; in Embodiment 6, anacceleration sensor is used for the inclination sensor. Referencenumeral 1406 denotes an amplifier that amplifies an output from theinclination sensor 1405. Reference numeral 1407 denotes a guide displaysignal generating circuit that generates a guide display signal(inclination guide display signal) in accordance with the inclinationinformation. Reference numeral 1408 denotes a display superimposingcircuit that synthesizes the still image signal obtained by the signalprocessing circuit 1403 with the guide display signal obtained by theguide display signal generating circuit 1407 and the still image storedin the image memory 1404. Reference numeral 1409 denotes a stitch imagepickup switch operated by the user in accordance with situations toswitch between a normal image pickup mode and the stitch image pickupmode.

Reference numeral 1410 denotes a microcomputer that controls storing andreading operations performed on the image memory and also controls thedisplay superimposing circuit 1408. Reference numeral 1411 denotes aviewfinder that can display an image produced by superimposing the guidedisplay signal and the still image being stored in the image memory 1404on the still image signal. Reference numeral 1412 denotes a recorderthat records the still image signal processed by the signal processingcircuit 1403.

In the above configuration, an image of the object picked up via thelens unit 1401 is formed on the CCD 1402, which then photoelectricallyconverts the image of the object into a signal. The signal processingcircuit 1403 subsequently converts the signal into a digital signal. Thesignal is then subjected to predetermined signal processing such asgamma correction and white balancing to become a still image signal. Thestill image signal is output to the recorder 1412, which records thesignal as a still image. The still image signal is also output to theimage memory 1404 and display superimposing circuit 1408.

On the other hand, the amplifier 1406 subjects the inclinationinformation obtained by the inclination sensor 1405 to a predeterminedmagnitude of amplification. The guide display signal generating circuit1407 then generates the guide display signal corresponding to theinclination information. Then, the display superimposing circuit 1408synthesizes the guide display signal with the still image signal tosuperimposedly display these signals on the viewfinder 1411.

Next, switching for stitch image pickup will be described. Switching tothe stitch image pickup via the stitch image pickup switch 1409 causesthe microcomputer 1410 to control the image memory 1404 to store thereinthe same picked-up image that is recorded in the recorder 1412.Moreover, part of the stored image is superimposedly displayed in theright or left of the screen so as to serve as a stitch guide for settingof the angle of view for the next image pickup.

Furthermore, in conjunction with switching via the stitch image pickupswitch 1409, the microcomputer 1109 outputs a display superimpositioncontrol signal to the display superimposing circuit 1408. The displaysuperimposing circuit 1408 permits or prohibits the synthesis of theguide display signal input by the guide display signal generatingcircuit 1407 with the still image signal obtained by the signalprocessing circuit 1403, in accordance with the display superimpositioncontrol signal. Specifically, if the mode is switched to the stitchimage pickup mode via the stitch image pickup switch 1409, the synthesisof the guide display signal with the still image signal is permitted. Incontrast, if the image pickup mode is switched to the normal imagepickup mode, the synthesis of the guide display signal with the stillimage signal is prohibited.

Next, processing executed by the microcomputer 1410 will be describedwith reference to FIG. 17. FIG. 17 is a flowchart showing the operationfor the stitch guide display and the guide display which are performedin the microcomputer 1410.

The flowchart is repeatedly implemented at a predetermined period. Theoperation is started at step S1501, and in step S1502, the processchecks whether the mode has been switched via the stitch image pickupswitch 1409 to the normal image pickup mode or the stitch image pickupmode. As a result, if the mode has been switched to the normal imagepickup mode, the process proceeds to step S1503. If the mode has beenswitched to the stitch image pickup mode, the process proceeds to stepS1509.

First, description will be given of the case where the mode has beenswitched to the normal image pickup mode. In this case, the processproceeds from step S1502 to step S1503 to prohibit the displaysuperimposing circuit 408 from performing a superimposing operation toprohibit the output of the guide display. This enables an image signalwith no guide display superimposed thereon to be output to theviewfinder 1411, which thus displays only the picked-up image. In nextstep S1504, the display superimposing circuit 1408 is prohibited fromperforming the superimposing operation to prohibit the image stored inthe image memory 1404 from being shown as the stitch guide display. Thisprecludes an image of the stitch guide display from being displayed onthe viewfinder 1411. In next step S1505, the process determines whetheror not a shutter button (not shown) has been pressed. If the shutterbutton has not been pressed, the process proceeds to step S1508 to endthe flow. If the shutter button has been pressed, the process proceedsto step S506 to, in this case, record the picked-up image in therecorder 1412. In next step S1507, the picked-up image is stored in theimage memory 1404. In subsequent step S1508, the flow is ended.

Further, if the process determines in step S1502 that the mode has beenswitched to the stitch image pickup mode, it proceeds to step S1509,where the display superimposing circuit 1408 performs the superimposingoperation in order to permit the output of the guide display. Thisenables an image with the guide display superimposed thereon to beoutput to the viewfinder 1411, which thus shows the guide displaysuperimposed on the picked-up image. In next step S1510, the processdetermines whether or not this image pickup is the first one afterswitching to the stitch image pickup mode. If it is the first imagepickup, the process proceeds to step S1512 to prohibit the displaysuperimposing circuit 1408 from performing the superimposing operationin order to prohibit the image stored in the image memory 1404 frombeing shown as the stitch guide display. This enables an image signalwith which no stitch guide display signal is synthesized to be output tothe viewfinder 1411, which thus display only the first picked-up image.

Further, for the second or subsequent image pickup, the process proceedsfrom step S1510 to step S1511 to permit the display superimposingcircuit 1408 to perform the superimposing operation in order to displaythe image stored in the image memory 1404 to the right or left of theprevious picked-up image, as the stitch guide display. This enables animage for the stitch guide display to be output to the viewfinder 1411,which thus provides the stitch guide display.

Accordingly, if the image pickup mode is switched from the normal imagepickup mode to the stitch image pickup mode via the stitch image pickupswitch 1409, the guide display superimposed on the picked-up image isshown on the viewfinder 1411 to enable the digital camera to be heldhorizontal. Then, after the first stitch image is picked-up, part of thelast picked-up image is displayed at an end of the viewfinder 1411; thepartial image constitutes the stitch guide display for continuous imagepickup.

Next, a flow of stitch image pickup will be described with reference toFIGS. 18A to 18C, using a superimposed image.

FIG. 18A is a diagram showing an image to be displayed on the viewfinder1411 when the first stitch image is picked up. As described above, theguide display 1601 is superimposed on the first picked-up image. Whenperforming still image pickup, the picked-up image of a compositionshown in FIG. 18A is stored in the image memory 1404. Subsequently, inorder to enable image pickup of the next still image consecutively, animage obtained by translating rightward part of the image stored in theimage memory 1404 is read. The read image constitutes the stitch guidedisplay as shown in FIG. 18B.

Then, in the state shown in FIG. 18B, the second picked-up image and theguide display that is superimposed thereon are shown on the viewfinder1411 to provide a viewfinder image shown in FIG. 18C. Also for the thirdand subsequent picked-up images, by using the displayed image shown inFIG. 18C as a guide, the stitch guide display and the guide display 1601are superimposedly shown on the viewfinder 1411 for enabling the camerato be held horizontal. This enables the generation of a plurality ofpicked-up images consecutively arranged leftward. The images areprocessed into a single horizontally long picked-up image. In thisexample, image pickup is repeated leftward. However, image pickup may becontinuously performed in the opposite direction.

The step of processing the picked-up images into a single horizontallylong image can be achieved by joining overlapping portions of thepicked-up images together. However, the step is not directly related tothe present invention, and its description is thus omitted.

According to Embodiment 6, even with a horizontally long picked-up imagethat is likely to be significantly affected by the inclination of thecamera, it is possible to urge the user to make the inclination of thecamera unnoticeable. This avoids making the image unsightly.

In the example described above in Embodiment 6, the present invention isapplied to a digital camera. However, the present invention is notlimited thereto but is applicable to an image pickup apparatus such as avideo camera having a function of picking up still images.

Embodiment 7

FIG. 19 is a block diagram showing the configuration of a circuit in avideo camera that is Embodiment 7 of the present invention. In FIG. 19,reference numeral 2101 denotes a lens unit used to pick up an image ofan object. Reference numeral 2102 denotes a CCD (Charge Coupled Device),which photoelectrically converts an image of the object formed by thelens unit 2101 into an analog picked-up image signal. Reference numeral2103 denotes a signal processing circuit that uses a built-in A/Dconverter to convert the analog picked-up image into a digital signal.The signal processing circuit 2103 then executes predetermined signalprocessing such as gamma correction and white balancing on the digitalsignal to generate a final standardized video signal.

Reference numeral 2106 denotes an inclination detection sensor thatdetects the inclination of the video camera (main body); in Embodiment7, an acceleration sensor is used for the inclination detection sensor.Reference numeral 2107 denotes an amplifier that amplifies an outputfrom the inclination detection sensor 2106. Reference numeral 2108denotes a camera microcomputer (hereinafter referred to as amicrocomputer) internally having a guide display generation controllingpart 2109, a camera controlling part 2110, and a shake signal outputdetermining part 2114. The camera controlling part 2110 controls thedrive of the CCD 2102 and the camera signal processing circuit 2103. Theguide display generation controlling part 2109 loads an output from theamplifier 2107 to generate a guide display signal corresponding to adetected inclination signal, that is, the current inclination of thevideo camera. In this case, if a control signal from the shake signaloutput determining part 2114, described below, has been input to theguide display generation controlling part 2109, the signal instructingthe guide display generation controlling part 2109 to output a guidedisplay signal to a display processing circuit 2104 described below,then the guide display generation controlling part 2109 outputs theguide display signal to the display processing circuit 2104.

Reference numeral 2104 denotes the display processing circuit thatoutputs an image signal from the camera signal processing circuit 2103,and that superimposes the guide display signal from the guide displaygeneration controlling part 2109 on the image signal to output theresulting signal to a display device 2105 such as a viewfinder or aliquid crystal panel. The display device 2105 thus displays only thepicked-up image or superimposedly shows the picked-up image and guidedisplay.

Reference numeral 2111 denotes a shake detection sensor such as anangular velocity sensor, which detects shake of the video camera.Reference numeral 2112 denotes a high pass filter (hereinafter referredto as an HPF) that removes a DC component from an output from the shakedetection sensor 2111. Reference numeral 2113 denotes an amplifier thatamplifies an output from the HPF 2112. An output from the amplifier 2113is input to the microcomputer 2108. Reference numeral 2114 denotes theshake signal output determining part provided in the microcomputer 2108.The shake signal output determining part 2114 compares the frequency ofthe output from the amplifier 2113 with a predetermined threshold todetermine whether or not the frequency has continuously exceeded thepredetermined threshold for a predetermined time. The shake signaloutput determining part 2114 then outputs, to the guide displaygeneration controlling part 2109, the control signal based on thedetermination, that is, the control signal indicating whether or not tooutput the guide display signal to the display processing circuit 2104.

Next, description will be given of specific operations performed by thevideo camera configured as described above.

Entering light having passed through the lens unit 2101 is formed intoan optical image on the CCD 2102, which then photoelectrically convertsthe image. The camera signal processing circuit 2103 A/D-converts anoutput from the CCD 2102 and then executes predetermined signalprocessing such as gamma correction and white balancing on the convertedsignal. The camera signal processing circuit 2103 thus outputs astandardized image (video) signal. The CCD 2102 and the camera signalprocessing circuit 2103 operate based on control signals from the cameracontrolling part 2110 in the microcomputer 2108. The image signal fromthe camera signal processing circuit 2103 is supplied to the displaydevice 2105 via the display processing circuit 2104 and is thenmonitored as a picked-up image. Processing executed by the displayprocessing circuit 2104 will be described below in detail.

Next, description will be given of detection of the inclination of thevideo camera and generation of the guide display signal.

The inclination detection sensor 2106 outputs a signal corresponding tothe inclination of the video camera. An output from the inclinationdetection sensor 2106 is amplified by a predetermined magnitude by theamplifier 2107 and then input to the microcomputer 2108 as aninclination signal. The inclination signal input to the microcomputer2108 is processed by the guide display generation controlling part 2109to generate the guide display signal corresponding to the inclination ofthe video camera. The shake signal output determining part 2114,described below, determines whether or not the guide display generationcontrolling part 2109 is to output the guide display signal to thedisplay processing circuit 2104. If the guide display signal is outputto the display processing circuit 2104, it is supplied to the displaydevice 2105 via the display processing circuit 2104 for monitoring.

FIGS. 20A to 20D shows the relationship between the inclination of thevideo camera and the inclination signal detected by the inclinationdetection sensor 2106. In FIG. 20, reference numerals 2100, 2105, and2106 denote the video camera, the display device such as a liquidcrystal panel, and the inclination detection sensor (accelerationsensor).

FIG. 20B shows a state in which the video camera is set for normal imagepickup (at a regular position). FIG. 20A shows that the video camerashown in FIG. 20B has been inclined counterclockwise by 90°. Further,FIG. 20A shows that the video camera shown in FIG. 20B has been inclinedclockwise by 90°.

FIG. 20D shows the characteristics of a detection output (sensor output)from the inclination detection sensor 2106, provided in the video camera2100 shown in FIGS. 20A to 20C. In FIG. 20D, the vertical axis indicatesthe sensor output, and the horizontal axis indicates the inclination ofthe video camera 2100. A line 2201 indicates the variation in outputfrom the inclination detection sensor 2106 based on the inclination ofthe video camera 2100. The illustrated output range can be obtained byappropriately setting the gain of the amplifier 2107, which amplifiesthe output from the inclination detection sensor 2106, shown in FIG. 19.

In FIG. 20D, (b′) denotes an output from the inclination detectionsensor 2106 obtained when the video camera 2100 is at the regularposition; the output is equal to half of the power supply voltage Vcc.In contrast, inclining the video camera 2100 counterclockwise by 90° asshown in FIG. 22A provides an output from the inclination detectionsensor 2106 equal to the power supply voltage, that is, provides theoutput to the value shown at (a′). Conversely, inclining the videocamera 2100 clockwise by 90° as shown in FIG. 22C provides an outputfrom the inclination detection sensor 2106 equal to a Gnd level (c′).With the inclination between (a′) and (b′) or between (b′) and (c′), theoutput from the inclination detection sensor 2106 changes linearly withthe inclination and offers a characteristic shown by the line 2201.Reversing the direction in which the inclination detection sensor 2106is mounted reverses the output characteristic of the inclinationdetection sensor 2106 to that shown in FIG. 20D. The guide displaysignal is generated on the basis of this characteristic.

Next, processing executed by the display processing circuit 2104 will bedescribed. The display processing circuit 2104 has a function ofsuperimposing the guide display signal from the guide display generationcontrolling part 2109 in the microcomputer 2108 on the image signal fromthe camera signal processing circuit 2103. That is, in this case, thedisplay processing circuit 2104 functions as a signal adder.Consequently, the picked-up image and guide display can besuperimposedly shown on the same display device 2105 via the displayprocessing circuit 2104.

The display state on the display device 2105 will be described withreference to FIG. 21. FIG. 21 is a diagram showing the guide displaysuperimposedly shown on the picked-up image on the display device 2105constituted by a liquid crystal panel, a viewfinder, or the like. In thefigure, reference numeral 2301 denotes a horizontal reference positionfor the video camera, which is actually not displayed. Reference numeral2302 denotes the guide display generated by the guide display generationcontrolling part 2109.

As shown in FIG. 21, superimposedly showing the guide display 2302inclined to the horizontal reference position 2301 for the video cameramakes it possible to urge the user to correct the inclination. Thehorizontal reference position 2301 corresponds to the sensor outputobtained when the video camera is at the regular position as shown inFIG. 20B. In Embodiment 7, the horizontal reference position 2301 is notdisplayed on the display device 2105 but may of course be displayed.When the horizontal reference position 2301 is displayed, it may havethe same shape (a solid line, a dashed line, or the like) and the samecolor as those of the guide display 2302 or a shape and a colordifferent from those of the guide display 2302.

Next, description will be given of a shake component applied to thevideo camera 2100.

The HPF 2112 removes a DC component from a shake signal output by theshake detection sensor 2111 such as an angular velocity sensor, theshake signal corresponding to shake of the video camera 2100.Subsequently, the amplifier 2113 amplifies the shake signal and inputsthe amplified signal to the microcomputer 2108. The shake signal outputdetermining part 2114 determines the state of the shake signal input tothe microcomputer 2108. Specifically, the shake signal outputdetermining part 2114 calculates the frequency of the input shake signalper unit time to determine whether or not at least a predeterminedfrequency value has been continuously detected for a predetermined time.The detected frequency of at least the predetermined value has only tobe equal to or greater than the frequency component of hand jiggling(for example, 5 [Hz]).

Next, the calculation of the frequency will be described. The frequencyis calculated by counting the number of increase and decreaseturnarounds of the shake signal per unit time. For example, twoturnarounds during one period per unit time correspond to 1 [Hz], thatis, the frequency is equal to half of the number of turnarounds.Consequently, for 10 turnarounds, “10/2=5”, that is, a frequency of 5[Hz] is calculated.

FIGS. 22A and 22B schematically show the shake signals obtained when thevideo camera 2100 is held by a user's hand and when it is fixed to atripod or the like. In FIG. 22A and FIG. 22B, the vertical axisindicates the output of a hand jigging signal. The horizontal axisindicates time.

In FIG. 22A, reference numeral 2401 denotes a shake signal obtained whenthe video camera 2100 is held by the user's hand. Increase and decreaseturnarounds in the output variation of the shake signal are continuous,so that the frequency of hand jiggling is detectable. In contrast, inFIG. 22B, reference numeral 2401′ denotes a shake signal obtained whenthe video camera is fixed to a tripod or the like. The shake signal hasa very small output variation and discontinuous increase and decreaseturnarounds, so that it is difficult to detect the frequencycorresponding to hand jiggling.

On the basis of the difference in shake signal, the shake signaldetermining part 2114 determines whether the video camera 2100 is heldby the user's hand or fixed.

On the basis of the determination, the shake signal determining part2114 supplies the guide display generation controlling part 2109 with abinary (Lo, Hi) control signal indicating whether or not to output theguide display signal to the display processing circuit 2104.Specifically, if the frequency of the shake signal is equal to orgreater than a predetermined value and the signal has been continuouslyinput for a predetermined time, the video camera is determined to beheld by the user's hand. Thus, the Lo control signal is output to theguide display generation controlling part 2109 to prevent the guidedisplay signal from being output to the display processing circuit 2104.Therefore, for hand-held image pickup, the guide display on the displaydevice 2105 is prohibited.

On the other hand, if the frequency of the shake signal is not equal toor greater than the predetermined value and this state is continuous forthe predetermined time, the video camera is determined to be fixed to atripod or the like. Thus, to enable the display processing circuit 2104to output the guide display signal, the Hi control signal is output tothe guide display generation controlling part 2109. Therefore, for imagepickup with the video camera fixed to a tripod or the like, the guidedisplay is permitted. The logic of the control signal may be reversedwithout any problem.

FIG. 23 is a flowchart showing the operation performed in themicrocomputer 2108 for the guide display.

In step S2501, the detection output (sensor output) from the inclinationdetection sensor 2106 is loaded. Then, in next step S2502, the guidedisplay signal is generated which corresponds to the inclinationdetection output loaded in step S2501. In subsequent step S2503, adetection output for shake of the video camera 2100 is loaded from theshake detection sensor 2111. Then, in next step S2504, the processdetermines whether or not the frequency of the shake detection outputloaded in step S2503 is equal to or greater than a predeterminedfrequency and this has continued for a predetermined time. If thefrequency is equal to or greater than the predetermined frequency andthis has continued for the predetermined time, it can be determined thatthe video camera 2100 is held by the user's hand during image pickup.The process thus proceeds to step S2505.

In step S2505, the output of the guide display signal generated in stepS2502 to the display processing circuit 2104 is stopped, and then theprocess ends. Accordingly, if the video camera 2100 is held by theuser's hand during image pickup, the display device 2105 is prohibitedfrom showing the guide display 2302.

Further, if the process determines in step S2504 that the frequency isnot equal to or greater than the predetermined value and this state hascontinued for the predetermined time or longer, the process candetermine that the video camera 2100 is fixed to a tripod or the like,and thus proceeds to step S2506. In step S2506, the output of the guidedisplay signal generated in step S2502 to the display processing circuit2104 is started, and then the process ends. Accordingly, if the videocamera 2100 is fixed to a tripod or the like, the display device 2105 ispermitted to show the guide display.

Embodiment 7, as described above, determines that the video camera 2100is held by the user's hand during image pickup if the shake of the videocamera 2100 is detected and if the frequency of the corresponding shakedetection signal is equal to or greater than the predetermined frequencyand this has continued for the predetermined time. In this case, thedisplay device 2105 is prohibited from providing the guide display 2302.This prevents user's inappropriate framing owing to his or her excessiveconsciousness of inclination of the video camera 2100. It is alsopossible to reduce disturbances to image pickup, for example, a constantmovement of the guide display 2302 on the display device 2105, whichmakes the user feel that the monitored image is cumbersome.

On the other hand, if the shake of the video camera 2100 is detected andif the frequency of the detection signal for the shake is not equal toor greater than the predetermined value and the shake has continued forthe predetermined time or longer, it is determined that the image pickupis done using a tripod. In this case, the display device 2105 ispermitted to show the guide display 2302. This enables the user toadjustably correct the inclination of the digital camera 2100 moreaccurately on the basis of the guide display 2302.

Embodiment 7, as described above, determines that the video camera isheld by the user's hand to prohibit the guide display if the frequencyof the detection output from the shake detection sensor is equal to orgreater than the predetermined value and if this has continued for thepredetermined time. Further, Embodiment 7 determines that the videocamera is fixed to a tripod to permit the guide display if the frequencyof the detection output from the shake detection sensor is not equal toor greater than the predetermined value and if this has continued forthe predetermined time. However, the present invention is not limitedthereto but may depend on the amplitude of the detection output from theshake detection sensor 2111. That is, if the amplitude is equal to orgreater than a predetermined value and this has consecutively beenoccurred a predetermined number of times, the guide display isprohibited. If the amplitude is not equal to or greater than thepredetermined value and this has consecutively been occurred thepredetermined number of times, the guide display is permitted.

The shake detection sensor in Embodiment 7 also serves to correct theshake of the video camera and need not be specifically provided in thevideo camera.

Embodiment 8

FIG. 24 is a block diagram showing the circuit configuration of an imagepickup apparatus that is Embodiment 8 of the present invention.Components similar to those of Embodiment 7, described above, aredenoted by the same reference numerals and will not be described. Thedescription of operations similar to those of Embodiment 7 is alsoomitted.

In FIG. 24, reference numeral 2601 denotes a high pass filter (HPF) thatremoves a DC component from the output from the inclination detectionsensor 2106. Reference numeral 2602 denotes an amplifier that amplifiesan output from the HPF 2601. The circuit in FIG. 24 corresponds to theconfiguration shown in FIG. 19 additionally provided with a path alongwhich the output from the inclination detection sensor 2106 has its bandlimited by the HPF 2601 and is amplified by the amplifier 2602.

Embodiment 7 controls whether or not to output the guide display signalgenerated from the inclination signal on the basis of the output stateof the shake signal corresponding to the shake of the video camera.Specifically, if the process determines that the camera is held by theuser's hand during image pickup, on the basis of the detection outputfrom the shake detection sensor 2111, no guide display signal is outputto prohibit the display device 2105 from superimposedly showing theguide display on the picked-up image. Further, if the process determinesthat the camera is fixed to a tripod or the like during image pickup, onthe basis of the detection output from the shake detection sensor 2111,the guide display signal is output to permit the display device 2105 tosuperimposedly show the guide display on the picked-up image.

In contrast, in Embodiment 8, the shake signal output determining part2114 determines whether or not to output the guide display signalgenerated from the detection output from the inclination detectionsensor 2106, on the basis of the state of an output signal obtained bylimiting the band of the detection output from the inclination detectionsensor 2106. Then, the guide display generation controlling part 2109outputs a control signal based on the determination to the displayprocessing circuit 2104. Thus, as is the case with Embodiment 7, forhand-held image pickup, the display device is prohibited fromsuperimposedly showing the guide display on the picked-up image. Forimage pickup with the camera fixed to a tripod or the like, the displaydevice is permitted to superimposedly show the guide display on thepicked-up image.

Next, specific operations of the above configuration will be described.The output from the inclination detection sensor 2106 is supplied to theamplifier 2107. At the same time, the output from the inclinationdetection sensor 2106 is also supplied to the HPF 2601, and a DCcomponent is then removed from the output from the inclination detectionsensor 2106. The resulting output is amplified by the amplifier 2602 bya predetermined amount and then input to the microcomputer 2108 as ashake variation signal. Since the shake variation signal input to themicrocomputer 2108 is a high frequency component of the output from theinclination detection sensor 2106, it can be considered to be a shakevariation signal for the video camera, that is, the shake signal inEmbodiment 7.

With reference to FIGS. 25A to 25C, explanation will be given of why theshake variation signal can be used as the shake signal.

In FIGS. 25A to 25 c, the vertical axis indicates sensor output, and thehorizontal axis indicates time. FIG. 25A shows a detection output (shakesignal) 2701 from the inclination detection sensor 2106. The detectionsignal is a mixture of a low frequency signal and a high frequencysignal, and the low frequency signal is used to generate the guidedisplay. FIG. 25B shows a shake variation signal 2701′ corresponding tothe detection output 2701 from the inclination detection sensor 2106having passed through the HPF 2601. The shake variation signal 2701′indicates that shake of the video camera is occurring and can thus beused as the shake signal by amplifying it by the amplifier 2602 by apredetermined amount. Further, FIG. 25C shows a shake variation signal2702 obtained when the video camera is fixed. FIG. 25C shows almost novariation is output, indicating that shake of the video camera is notoccurring.

As is apparent from FIGS. 25A to 25C, using the shake variation signalas the shake signal enables the control signal from the shake signaloutput determining part 2114 to be output to the guide displaygeneration controlling part 2109 on the basis of the frequency of thepredetermined value detected from the shake signal as well as the timefor which the frequency is continuously detected, as is the case withEmbodiment 7. This makes it possible to achieve operations forprohibiting and permitting the guide display.

Next, with reference to the flowchart in FIG. 26, description will begiven of the operation performed by the microcomputer 2108 for the guidedisplay.

First, in step S2801, the detection output from the inclinationdetection sensor 2106 is loaded. Then, in next step S2802, the guidedisplay corresponding to the inclination detection output loaded in stepS2801 is generated. In subsequent step S2803, the detection output fromthe inclination detection sensor 2106, which corresponds to the shake ofthe video camera, is passed through the HPF 2601. The detection outputis then amplified by the predetermined value by the amplifier 2602 andloaded as a high frequency inclination signal.

In next step S2804, the process determines whether or not the frequencyof the shake detection output loaded in step S2803 is equal to orgreater than a predetermined value and this has continued for apredetermined time. If the frequency is equal to or greater than thepredetermined value and this has continued for the predetermined time,the process determines that the video camera is held by the user's handduring image pickup and thus proceeds to step S2805. In step S2805, theoutput of the guide display generated in step S2802 is stopped, and thenthe process ends. Accordingly, when the video camera is held by theuser's hand during image pickup, the display device 2105 is prohibitedfrom providing the guide display.

Further, if the process determines in step S2804 that the frequency isnot equal to or greater than the predetermined value and this hascontinued for the predetermined time, the process determines that thevideo camera is fixed to a tripod or the like and thus proceeds to stepS2806. In step S2806, the output of the guide display generated in stepS2802 is started, and then the process ends. Accordingly, when the videocamera is fixed to a tripod or the like, the display device 2105 ispermitted to provide the guide display.

Embodiment 8 determines that the video camera is held by the user's handduring image pickup if the frequency of the shake signal correspondingto the detected shake of the video camera is equal to or greater thanthe predetermined frequency and this has continued for the predeterminedtime. Then, the display device 2105 is prohibited from providing theguide display. This prevents user's inappropriate framing owing to hisor her excessive consciousness of inclination of the video camera 2100.It is also possible to reduce disturbances to image pickup, for example,a constant movement of the guide display 2302 on the display device2105, which makes the user feel that the monitored image is cumbersome.

On the other hand, if the frequency of the shake signal corresponding tothe detected shake of the video camera is not equal to or greater thanthe predetermined value and if this has continued for the predeterminedtime, it is determined that the image pickup is done using a tripod.Then, the display device 2105 is permitted to show the guide display.This enables the user to correct the inclination of the digital cameramore accurately on the basis of the guide display.

Embodiment 8 determines that the video camera is held by the user's handif the frequency of the detection output from the inclination detectionsensor 2106 having its band limited is equal to or greater than thepredetermined value and this has continued for the predetermined time.In this case, the guide display is prohibited from being provided.Further, Embodiment 8 determines that the video camera is fixed to atripod if the frequency of the detection output from the inclinationdetection sensor having its band limited is not equal to or greater thanthe predetermined value and this has continued for the predeterminedtime. Then, the guide display is permitted to be provided.

However, the present invention is not limited to this but may depend onthe amplitude of the shake variation signal of the detection output fromthe inclination detection sensor 2106 having its band limited toprohibit and permit the guide display. That is, if the amplitude of theshake variation signal is equal to or greater than a predetermined valueand this has consecutively been occurred a predetermined number oftimes, the guide display is prohibited. If the amplitude of the shakevariation signal is not equal to or greater than the predetermined valueand this has consecutively been occurred the predetermined number oftimes, the guide display is permitted.

Further, in the description of Embodiment 8, the HPF 2601, which limitsthe band of the output from the inclination detection sensor 2106, isconstituted by hardware. However, the guide display can be similarlyprohibited and permitted by providing the HPF in the microcomputer 2108,amplifying the output from the inclination detection sensor 2106 via theamplifier 2107 to generate an inclination amplified signal, limiting theband of the inclination amplified signal, and supplying the signal tothe shake signal output determining part 114.

Embodiment 9

FIG. 27 is a block diagram showing the circuit configuration of an imagepickup apparatus that is Embodiment 9 of the present invention.Components similar to those of Embodiment 7, described above, aredenoted by the same reference numerals and will not be described. Thedescription of operations similar to those of Embodiment 7 is alsoomitted.

In FIG. 27, reference numeral 2901 denotes a memory that stores thesignal from the camera signal processing circuit 2103. Reference numeral2902 denotes a motion vector detecting part that detects a motion vectoron the basis of the signal stored in the memory 2901 and the output fromthe camera signal processing circuit 2103. Reference numeral 2903denotes a motion vector determining part that determines the motion of apicked-up image on the basis of the motion vector detected by the motionvector detecting part 2902. Reference numeral 2904 denotes a motionvector state determining part that determines the state of the motionvector on the basis of the output from the motion vector determiningpart 2903. The circuit in FIG. 27 corresponds to the configuration inFIG. 19 which detects motion vectors in the picked-up image to controlwhether or not to output the guide display on the basis of the outputmotion vector.

Embodiment 7 controls whether or not to output a guide display signalgenerated from the inclination signal on the basis of the output stateof the shake signal corresponding to the shake of the video camera.Specifically, if the process determines that the camera is held by theuser's hand during image pickup, on the basis of the detection outputfrom the shake detection sensor 2111, no guide display signal is outputto prohibit the display device 2105 from superimposedly showing theguide display on the picked-up image. Further, if the process determinesthat the camera is fixed to a tripod or the like during image pickup, onthe basis of the detection output from the shake detection sensor 2111,the guide display signal is output to permit the display device 2105 tosuperimposedly show the guide display on the picked-up image.

In contrast, Embodiment 9 controls whether or not to output the guidedisplay signal generated from the inclination signal on the basis of themotion vector. Specifically, if the process determines that the camerais held by the user's hand during image pickup, on the basis of themotion vector, the display device 2105 is prohibited from superimposedlyshowing the guide display on the picked-up image. If the processdetermines that the camera is fixed to a tripod or the like during imagepickup, the display device 2105 is permitted to superimposedly show theguide display on the picked-up image.

A conventional block matching method is used for detecting the motionvector in Embodiment 9. Specifically, an input image signal is dividedinto a plurality of blocks of an appropriate size (for example, 8pixels×8 lines). For a given range of pixels in each block, thedifferences in pixels in the preceding field (or frame) and the currentone are calculated. Then, a block of the preceding field (or frame)having the minimum sum of the absolute values of the differences issearched for. The relative displacement of this block indicates itsmotion vector.

Next, specific operations of the above configuration will be described.The image signal output from the camera signal processing circuit 2103,which is a target to detect the motion vector, is input to the memory2901, which is a field (or frame) memory, and to the motion vectordetecting part 2902 in the microcomputer 2108. The memory 2901 is usedas one-field period delayer.

The motion vector detecting part 2902 calculates a correlation valuebetween the current field and the preceding field that is stored in thememory 2901, for each block according to the block matching. Then, asignal indicating the calculation result is detected on the basis of thecorrelation value as the motion vector for each block. Specifically, ablock of the preceding field having the maximum correlation value issearched for. The relative displacement of this block indicates itsmotion vector. The detected motion vector is then output to the motionvector determining part 2903.

The motion vector determining part 2903, following the motion vectordetecting part 2902, determines the total motion vector on the basis ofthe motion vectors of the blocks. Specifically, the median or average ofthe motion vectors of the blocks is determined to be the total motionvector. A signal indicating the total motion vector determined by themotion vector determining part 2903 is output to the motion vector statedetermining part 2904.

The motion vector state determining part 2904, following the motionvector determining part 2903, supplies a binary (Lo, Hi) control signalindicating whether or not to display the guide display on the displaydevice 2105, the guide display being generated by the guide displaygeneration controlling part 2109. Specifically, if the absolute value ofthe motion vector determined for each vertical synchronization signal(hereinafter referred to as each V period) by the motion vectordetermining part 2903 is equal to or greater than a predetermined valueand the motion vector changes with the V period, the motion vector statedetermining part 2904 determines that the video camera is held by theuser's hand. The motion vector state determining part 2904 outputs theLo control signal to the guide display generation controlling part 2109so as to prevent the output of the guide display signal. Consequently,when the video camera is held by the user's hand during image pickup,the guide display on the display device 2105 is prohibited.

If the absolute value of the motion vector determined for every V periodby the motion vector determining part 2903 is not equal to or greaterthan the predetermined value and the motion vector does not virtuallychange at every V period, the motion vector state determining part 2904determines that the video camera is fixed to a tripod or the like. Themotion vector state determining part 2904 outputs the Hi control signalto the guide display generation controlling part 2109 so as to permitthe output of the guide display signal. Consequently, when the videocamera is fixed to a tripod or the like during image pickup, the guidedisplay on the display device 2105 is permitted. The logic of controlsignals controlling the prohibition and permission of the guide displaymay be reversed without posing any problem.

Next, with reference to the flowchart in FIG. 28, description will begiven of the operation performed by the microcomputer 2108 for the guidedisplay.

First, in step S2001, the detection output from the inclinationdetection sensor 2106 is loaded. In next step S2002, the guide displayis generated which corresponds to the inclination detection outputloaded in step S2001. In subsequent step S2003, motion vectorinformation detected in an image picked-up with the video camera isloaded.

In next step S2004, the process determines whether or not the absolutevalue of the motion vector loaded in step S2003 is equal to or greaterthan the predetermined value and changes at every V period. If theabsolute value of the motion vector is equal to or greater than thepredetermined value and changes at every V period, the processdetermines that the video camera is held by the user's hand during imagepickup and thus proceeds to step S2005. In step S2005, the output of theguide display generated in step S2002 is stopped, and then the processends. This prohibits the guide display on the display device 2105.

Further, if the process determines in step S2004 that the absolute valueof the motion vector is not equal to or greater than the predeterminedvalue and does not virtually change at every V period, it can determinethat the video camera is fixed to a tripod or the like during imagepickup and thus proceeds to step S2006. In step S2006, the output of theguide display generated in step S2002 is started, and then the processends. This permits the guide display on the display device 2105.

Embodiment 9 detects the motion vector in the image picked-up with thevideo camera. If the absolute value of the motion vector determined forevery vertical synchronization signal (every V period) is equal to orgreater than the predetermined value and changes at every V period, theprocess determines that the video camera is held by the user's hand.Then, the provision of the guide display on the display device 2105 isprohibited. This prevents user's inappropriate framing owing to his orher excessive consciousness of inclination of the video camera. It isalso possible to reduce disturbances to image pickup, for example, aconstant movement of the guide display on the display device 2105, whichmakes the user feel that the monitored image is cumbersome.

If the absolute value of the motion vector determined for every verticalsynchronization signal (every V period) is not equal to or greater thanthe predetermined value and does not virtually change at every V period,the display device 2105 is permitted to show the guide display. Thisenables the user to correct the inclination of the digital camera moreaccurately on the basis of the guide display.

Although not described in Embodiment 9, the shake of the video cameracan be corrected on the basis of the motion vector by placing, betweenthe camera signal processor 2103 and the display processing circuit2104, an image processor capable of image controlling on the basis ofthe output from the motion vector determining part 2903 in themicrocomputer 2108.

Embodiment 10

FIG. 29 is a block diagram showing the outlined configuration of a videocamera that is Embodiment 10. Reference numeral 3101 denotes a lens unitused to pick up an image of an object. Reference numeral 3102 denotes aCCD that photoelectrically converts an object image formed by the lensunit 3101 into an analog image pickup signal.

Reference numeral 3103 denotes a camera signal processing circuit thatuses a built-in A/D converter to covert the analog image pickup signalinto a digital signal and executes predetermined signal processing suchas gamma correction and white balancing on the digital signal togenerate a final standardized video signal.

Reference numeral 3104 denotes a display processing circuit that outputsand displays the output video signal from the camera signal processingcircuit 3103 on which a guide display signal (described later) issuperimposed, on a display device 3105. Reference numeral 3105 denotesthe display device such as a viewfinder or a liquid crystal panel.

Reference numeral 3106 denotes an inclination detection sensor thatdetects the inclination of the video camera and that is constituted by,for example, an acceleration sensor. Reference numeral 3107 denotes anamplifier circuit that amplifies an output from the inclinationdetection sensor 3106.

Reference numeral 3111 denotes a shake detection sensor that detectsshake of the video camera and that is constituted by, for example, anangular velocity sensor. Reference numeral 3112 denotes a high passfilter (HPF) that removes a DC component from an output from the shakedetection sensor 3111. Reference numeral 3113 denotes an amplifiercircuit that amplifies an output from the HPF 3112.

Reference numeral 3108 denotes a camera system controlling microcomputer(hereinafter referred to as a microcomputer) including a cameracontrolling part 3110, a guide display generation controlling part 3109,and a shake signal output determining part 3114. The camera controllingpart 3110 controls the drive of the CCD 3102 and the camera signalprocessing circuit 3103. The guide display generation controlling part3109 loads an output from the amplifier circuit 3107 to generate theguide display signal corresponding to the detected inclination. Theguide display generation controlling part 3109 then outputs the guidedisplay signal to the display processing circuit 3104. Further, theguide display generation controlling part 3109 controls the output ofthe guide display signal on the basis of a control signal from the shakesignal output determining part 3114. The shake signal output determiningpart 3114 compares the frequency of an output from the amplifier circuit3113 with a predetermined threshold to determine whether or not thefrequency has continuously exceeded the threshold for a predeterminedtime. On the basis of the determination, the shake signal outputdetermining part 3114 outputs a control signal to the guide displaygeneration controlling part 3109.

In the video camera of the present embodiment, entering light havingpassed through the lens unit 3101 is formed into an image on an imagepickup surface of the CCD 3102, which then photoelectrically convertsthe image in to an analog signal. The camera signal processing circuit3103 executes an A/D conversion on the output from the CCD 3102 and thensubjects the converted output to predetermined signal processing such asgamma correction and white balancing. The camera signal processingcircuit 3103 outputs the resulting signal as a standardized videosignal. The output video signal from the camera signal processingcircuit 3103 is supplied, via the display processing circuit 3104, tothe display device 3105, on which it is monitored as a picked-up image.

Next, description will be given of detection of the inclination of thevideo camera and generation of the guide display. The inclinationdetection sensor 3106 outputs a detection signal based on theinclination of the video camera. The output from the inclinationdetection sensor 3106 is amplified by a predetermined amount by theamplifier circuit 3107 and then input to the microcomputer 3108 as aninclination detection signal. On the basis of the inclination detectionsignal input to the microcomputer 3108, the guide display generationcontrolling part 3109 generates the guide display signal correspondingto the inclination of the video camera. The guide display signal iscontrolled using the shake signal output determining part 3114. Theguide display signal output by the guide display generation controllingpart 3109 is supplied to the display device 3105 via the displayprocessing circuit 3104.

Next, description will be given of a shake component acting on the videocamera. The shake detection sensor 3111 outputs the shake detectionsignal on the basis of the shake of the video camera. A DC componentfrom the output from the shake detection sensor 3111 is removed by theHPF 3112. The resulting output is amplified by a predetermined amount bythe amplifier circuit 3113. The amplified signal is input to themicrocomputer 3108 as the shake detection signal. On the basis of theshake detection signal input to the microcomputer 3108, the shake signaloutput determining part 3114 determines the state of the shake detectionsignal. Specifically, the shake signal output determining part 3114calculates and compares the frequency of the input shake detectionsignal with the predetermined threshold to determine whether or not thefrequency has continuously exceeded the threshold for a set time. Thethreshold of the frequency may be set so as to enable the frequencycomponent of hand jiggling (for example, 5 [Hz] or higher) to bedetected.

Next, the calculation of the frequency of the shake detection signalwill be described. The frequency is calculated by counting increase anddecrease turnarounds of the shake detection signal per unit time. Forexample, two turnarounds during one period per unit time is equal to 1[Hz], that is, the frequency is half of the number of turnarounds.Accordingly, for 10 turnarounds, 10/2=5 [Hz] is calculated.

FIGS. 33A and 33B are characteristic diagrams showing shake detectionsignals obtained when the video camera is held by the user's hand duringimage pickup and when the video camera is fixed to a tripod or the likeduring image pickup. In FIGS. 33A and 33B, the vertical axis indicatesthe shake detection signal. The horizontal axis indicates time. Acharacteristic line 3501 in FIG. 33A indicates the shake detectionsignal obtained when the video camera is held by the user's hand duringimage pickup. Increase and decrease turnarounds in the output variationof the shake detection signal are continuous. This signal component thusenables the frequency of hand jiggling to be detected. In contrast, acharacteristic line 3501′ in FIG. 33B indicates the shake detectionsignal obtained when the video camera is fixed. The output variation ofthe shake detection signal is very small and increase and decreaseturnarounds are discontinuous. Accordingly, this signal component doesnot enable the frequency equivalent to hand jiggling to be easilydetected. This difference between the shake detection signals makes itpossible to determine whether the video camera is held by the user'shand or fixed during image pickup.

The shake signal output determining part 3114, on the basis of thisdetermination, supplies a control signal to the guide display generationcontrolling part 3109, the control signal being a binary (Lo, Hi) shakesignal output determination signal indicating whether or not the camerais held by the user's hand or fixed during image pickup. That is, if thefrequency of the input shake detection signal has continuously exceededthe threshold for the set time, the process determines that the camerais held by the user's hand during image pickup to output the shakeoutput determination signal (Lo). In contrast, if the frequency of theinput shake detection signal has not continuously exceeded the thresholdfor the set time, the process determines that the camera is fixed duringimage pickup to output the shake output determination signal (Hi). Thelogic of the control signal may be reversed without posing any problem.

Next, with reference to the flowchart in FIG. 30, description will begiven of output control of the guide display signal performed in themicrocomputer 3108. FIG. 30 is a flowchart illustrating the processingoperation performed by the guide display generation controlling part3109 in the microcomputer 3108. First, in step S3201, the inclinationdetection signal is loaded from the inclination detection sensor 3106via the amplifier circuit 3107.

Then, in step S3209, the shake signal output determination signal isloaded from the shake signal output determining part 3114. In stepS3202, determination is made on the basis of the shake signal outputdetermination signal loaded in step S3209. For fixed image pickup, theprocess proceeds to step S3206. For handheld image pickup, the processproceeds to step S3203.

For the handheld image pickup, the process determines in step S3203whether or not the inclination of the video camera is equal to or largerthan a set value α. If the inclination is equal to or larger than theset value α, then in step S3204, the guide display is set to be turnedon. In contrast, if the inclination is smaller than the set value α,then in step S3207, the guide display is set to be turned off.

On the other hand, for the fixed image pickup, the process determines instep S3206 whether or not the inclination of the video camera is equalto or larger than a set value β. If the inclination is equal to orlarger than the set value β, then in step S3204, the guide display isset to be turned on. In contrast, if the inclination is smaller than theset value β, then in step S3207, the guide display is set to be turnedoff.

In step S3205, the display processing circuit 3104 is instructed toprovide the guide display. That is, after step S3204 is executed, theguide display signal is generated, output, and superimposed on theoutput video signal from the camera signal processing circuit 3103 (thatis, the guide display is shown). In contrast, after step S3207 isexecuted, the superimposition of the guide display signal on the outputvideo signal from the camera signal processing circuit 3103 is avoided(that is, the guide display is not shown).

In this case, the relationship between the set values α and β is α>β.The inclination at which the guide display is turned on or off is setsmaller for the fixed image pickup than for the handheld image pickup.That is, for the fixed image pickup, in which the inclination of thevideo camera is more noticeable, the guide display is provided at thesmaller inclination.

Further, the present embodiment determines that the camera is held bythe user's hand during image pickup if the frequency of the output fromthe shake detection sensor 3111 has not continuously exceeded thethreshold for the set time and determines that the camera is fixed ifthe frequency has continuously exceeded the threshold for the set time.However, the image pickup state may be determined on the basis ofamplitude of the output from the shake detection sensor 3111.

Moreover, the present embodiment uses the shake detection sensor 3111 todetect the shaking state of the video camera. However, the shaking statecan also be detected on the basis of the shake detection signal obtainedby limiting the band of the detection signal from the inclinationdetection sensor 3106 or a motion vector detected in a picked-up image.

FIGS. 31A to 31B are diagrams showing the relationship between theinclination of the video camera and the output from the inclinationdetection sensor (acceleration sensor) 3106. In FIGS. 31A to 31C,reference numerals 3100, 3105, and 3106 denote the video camera, theliquid crystal panel as the display device, and the inclinationdetection sensor, respectively. Appropriately setting of the gain of theamplifier circuit 3107 enables the output from the inclination detectionsensor 3106 to be set within the voltage range described below.

FIG. 31B shows a state where the video camera is at a regular position.In this state, the output from the inclination detection sensor 3106 isequal to half of a power supply voltage Vcc. In contrast, inclining thevideo camera 3100 clockwise by 90° as shown in FIG. 31A provides anoutput from the inclination detection sensor 3106 equal to the powersupply voltage Vcc. Conversely, inclining the video camera 3100counterclockwise by 90° as shown in FIG. 31C provides an output from theinclination detection sensor 3106 at a GND level.

For the inclinations between those shown in FIG. 31A and FIG. 31B andbetween those shown in FIG. 31B and FIG. 31C, the output from theinclination detection sensor 3106 changes linearly with the inclination.Accordingly, providing a predetermined voltage threshold for the outputcorresponding to the regular position shown in FIG. 31B makes itpossible to determine whether or not a predetermined angle has beenreached. That is, switching the voltage threshold for the sensor outputbetween the handheld image pickup and the fixed image pickup makes itpossible to set the inclination value at which the guide display isturned on or off. Reversing the orientation of the inclination detectionsensor 3106 reverses the sensor output voltage obtained when the videocamera is inclined, with respect to that shown in FIG. 31.

FIG. 32 shows the range where the guide display is shown on the displaydevice 3105. By switching the voltage threshold of the sensor outputbetween the handheld image pickup and the fixed image pickup asdescribed above, it is possible to make the area in which the guidedisplay is turned off narrower for the fixed image pickup than for thehandheld image pickup, as shown in FIG. 32. This makes it possible tomore quickly determine that the video camera is inclined when the videocamera is fixed to a tripod or the like.

As described above, the guide display suitable for the image pickupstate can be provided by detecting the shake of the video camera tochange the set value of the inclination at which the guide display isturned on or off. That is, for the handheld image pickup, the area inwhich the guide display is turned off is widened to prevent user'sinappropriate framing owing to his or her excessive consciousness of theinclination of the video camera. This also prevents the user fromfeeling that the monitored image is cumbersome because of a constantmovement of the guide display. Disturbances to image pickup can thus bereduced. On the other hand, for the fixed image pickup, the area inwhich the guide display is turned off is narrowed to enable the user tocorrect the inclination of the video camera on the basis of the guidedisplay. This is effective for improving image pickup accuracy.

Embodiment 11

Embodiment 11 of the present invention will be described. Theconfiguration of a video camera that is Embodiment 11 is similar to thatin Embodiment 10 and its detailed description is thus omitted.

FIG. 34 is a flowchart illustrating the processing operation performedby the guide display generation controlling part 3109 in themicrocomputer 3108. First, in step S3601, the inclination detectionsignal is loaded from the inclination detection sensor 3106 via theamplifier circuit 3107.

Then, in step S3609, the shake signal output determination signal isloaded from the shake signal output determining part 3114.

Then, in step S3602, the process determines whether or not theinclination of the video camera is equal to or larger than the set valueα. If the inclination is equal to or larger than the set value α, thenin step S3603, the guide display is set to be turned on. In contrast, ifthe inclination is smaller than the set value α, then in step S3607, theguide display is set to be turned off.

In step S3604, determination is made on the basis of the shake signaloutput determination signal loaded in step S3609. For the fixed imagepickup, the process proceeds to step S3605 to increase displaysensitivity. This is an operation for exaggerating the guide display. Onthe other hand, for the handheld image pickup, the process proceeds tostep S3606, the display sensitivity (the level of exaggeration) is setto a normal value.

In step S3608, the display processing circuit 3104 is instructed toprovide the guide display. That is, after step S3603 is executed, theguide display signal is generated and output to superimpose the guidedisplay on the output video signal from the camera signal processingcircuit 3103 (that is, the guide display is shown). In contrast, afterstep S3607 is executed, the superimposition of the guide display on theoutput video signal from the camera signal processing circuit 3103 isavoided (that is, the guide display is not shown).

FIGS. 35A and 35B show a guide display provided when the displaysensitivity is changed that is Embodiment 11. As is apparent from FIGS.35A and 35B, even with the same inclination of the video camera from ahorizontal position, the guide display for the fixed image pickup isexaggerated compared to that for the handheld image pickup (in otherwords, even with the same inclination, the guide display is more steeplyinclined for the fixed image pickup). Exaggerating the guide display forthe fixed image pickup makes the inclination of the video camera clearerto enable the user to recognize the inclination more easily. Further,during the fixed image pickup, a change in inclination in response to aslight movement can be more easily recognized, enabling the video camerato be more easily set horizontal.

As described above, the guide display suitable for the image pickupstate can be provided by detecting the shake of the video camera tochange the display sensitivity of the guide display (the level ofexaggeration). That is, the display sensitivity (the level ofexaggeration) is set higher for the fixed image pickup than for thehandheld image pickup. This exaggerates the guide display to enable theuser to be noticed of the inclination of the video camera when the fixedimage pickup is performed in which an inclination of the image pickupresult is conspicuous. This enables the user to recognize theinclination more easily. Moreover, the amount of a change in theinclination of the video camera in response to its slight movement canbe clearly determined, enabling the video camera to be more easily sethorizontal.

Embodiment 12

Embodiment 12 of the present invention will be described. The basicconfiguration of a video camera that is Embodiment 12 is similar to thatshown in FIG. 29. However, as shown in FIG. 36, a variable gainamplifier circuit 3801 replaces the amplifier circuit 3107.

A microcomputer 3802 in the present embodiment further includes a gaincontrolling part 3803 that changes the gain of the variable gainamplifier circuit 3801.

FIG. 38 is a diagram showing an example of configuration of the variablegain amplifier circuit 3801. The variable gain amplifier circuit 3801 isconstituted by an amplifier 3805, resistors 3806, and a gain switch3804. A switch signal from the camera controlling microcomputer 3802connects input resistors 3806 in parallel with each other with respectto the amplifier 3805 to increase the amplifier gain. The change of thegain is effected in order to exaggerate the guide display for the fixedimage pickup.

FIG. 37 is a flowchart illustrating the processing operation performedby the guide display generation controlling part 3109 and gaincontrolling part 3803 in the microcomputer 3802. First, in step S3901,the inclination detection signal is loaded from the inclinationdetection sensor 3106 via the variable gain amplifier circuit 3801.

Then, in step S3911, the shake signal output determination signal isloaded from the shake signal output determining part 3114. In stepS3902, determination whether or not the fixed image pickup is performedis made on the basis of the shake signal output determination signalloaded in step S3911. If the fixed image pickup is performed, theprocess proceeds to step S3903. If the handheld image pickup isperformed, the process proceeds to step S3909.

For the fixed image pickup, the process checks in step S3903 whether ornot the sensor sensitivity has been increased. In this case, the processdetermines whether or not the gain of the variable gain amplifiercircuit 3801 is set higher. In step S3903, if the sensor sensitivity hasbeen increased, the process proceeds to step S3904. If the sensorsensitivity has not been increased, then in step S3908, setting is madeso as to raise the gain to increase the sensor sensitivity.

On the other hand, for the handheld image pickup, the process checks instep S3909 whether or not the sensor sensitivity is set at a normalvalue. If in step S3909 the sensor sensitivity is not set at the normalvalue, that is, it is set for the fixed image pickup, then in stepS3910, it is changed to the normal value. This is an operation forturning off the gain switch 3704 in the variable gain amplifier circuit3801. If in step S3909 the sensor sensitivity is set at the normalvalue, the process proceeds to step S3904.

In step S3904, the process determines whether or not the inclination ofthe video camera is equal to or larger than the set value α. If theinclination is equal to or larger than the set value α, then in stepS3905, the guide display is set to be turned on. In contrast, if theinclination is smaller than the set value α, then in step S3907, theguide display is set to be turned off.

In step S3906, the display processing circuit 3104 is instructed toprovide the guide display. That is, after step S3905 is executed, theguide display signal is generated and output to superimpose the guidedisplay on the output video signal from the camera signal processingcircuit 3103 (that is, the guide display is shown). In contrast, afterstep S3907 is executed, the superimposition of the guide display on theoutput video signal from the camera signal processing circuit 3103 isavoided (that is, the guide display is not shown).

As described above, the guide display suitable for the image pickupstate can be provided by detecting the shake of the video camera tochange the sensor sensitivity of the inclination detection sensor 3106.That is, as in Embodiment 11, the gain of the variable gain amplifiercircuit 3801 is set higher for the fixed image pickup than for thehandheld image pickup to enable the user to be noticed of theinclination of the video camera during the fixed image pickup so as torecognize the inclination more easily. Moreover, the amount of a changein inclination of the video camera in response to its slight movementcan be clearly determined, enabling the video camera to be more easilyset horizontal.

Embodiment 13

Embodiment 13 of the present invention will be described. As describedin Embodiments 10 and 11, Embodiment 13 switches the set value of theinclination at which the guide display is turned on or off between thehandheld image pickup and the fixed image pickup, and the displaysensitivity is increased during the fixed image pickup to exaggerate theguide display.

FIG. 39 is a flowchart illustrating the processing operation performedby the guide display generation controlling part 3109 in themicrocomputer 3108. First, in step S3101, the inclination detectionsignal is loaded from the inclination detection sensor 3106 via theamplifier circuit 3107.

Then, in step S3109, the shake signal output determination signal isloaded from the shake output determining part 3114. In step S3102,determination whether or not the fixed image pickup is performed is madeon the basis of the shake signal output determination signal loaded instep S3109. If the fixed image pickup is performed, the process proceedsto step S3103. If the handheld image pickup is performed, the processproceeds to step S1106.

For the fixed image pickup, the process determines in step S3103 whetheror not the inclination of the video camera is equal to or larger than aset value β. If the inclination is equal to or larger than the set valueβ, then in step S3104, the guide display is set to be turned on and thedisplay sensitivity (the level of exaggeration) is increased. Incontrast, if the inclination is smaller than the set value β, then instep S3108, the guide display is set to be turned off.

On the other hand, for the handheld image pickup, in step S3106, theprocess determines whether or not the inclination of the video camera isequal to or larger than a set value α. If the inclination is equal to orlarger than the set value α, then in step S3107, the guide display isset to be turned on. In contrast, if the inclination is smaller than theset value α, then in step S3108, the guide display is set to be turnedoff.

In step S3105, the display processing circuit 3104 is instructed toprovide the guide display. That is, after steps S3104 and S3107 areexecuted, the guide display signal is generated and output tosuperimpose the guide display on the output video signal from the camerasignal processing circuit 3103 (that is, the guide display is shown). Incontrast, after step S3108 is executed, the superimposition of the guidedisplay on the output video signal from the camera signal processingcircuit 3103 is avoided (that is, the guide display is not shown).

In short, for the fixed image pickup and if in step S3103 theinclination is smaller than the set value β, or for the handheld imagepickup and if in step S3106 the inclination is smaller than the setvalue α, then the video camera is almost horizontal. Thus, in stepS3108, the guide display is set to be turned off.

In this case, the relationship between the set values α and β is set tobe α>(display sensitivity magnification×β). The set value of theinclination at which the guide display is turned on is always smallerfor the fixed image pickup than for the handheld image pickup. The levelof exaggeration of the guide display for the fixed image pickupincreases consistently with the inclination of the video camera.

As described above, for the fixed image pickup, when the inclination ofthe video camera is more noticeable, the guide display for theinclination of the video camera is provided at a smaller inclination.This enables the user to be quickly noticed of the inclination of thevideo camera. Further, at a larger inclination, the guide display thatexaggerates the actual inclination is provided to make the inclinationof the video camera clearer. Moreover, a change in inclination inresponse to a slight movement can be more easily recognized, enablingthe video camera to be more easily set horizontal. This also enableshorizontal accuracy to be improved.

Embodiment 14

FIG. 40 is a block diagram showing the outlined configuration of a videocamera that is Embodiment 14. Reference numeral 4101 denotes a lens unitincluding a first fixed lens sub-unit, a zoom lens sub-unit for zooming,an aperture stop and a second fixed lens sub-unit (they are not shown).Reference numerals 4102, 4103, and 4104 denote a zoom driving source, anaperture stop driving source, and a focusing driving source,respectively.

Reference numeral 4107 denotes a CCD that is an image pickup element.Reference numeral 4108 denotes an AGC (Auto Gain Control circuit) thatamplifies an output from the CCD 4107. Reference numeral 4109 denotes acamera signal processing circuit that executes predetermined signalprocessing on an output signal from the AGC 4108. Reference numeral 4110denotes a display processing circuit that converts an output signal fromthe camera signal processing circuit 4109 into a signal suitable for adisplay device 4111. Reference numeral 4111 denotes the display devicesuch as a viewfinder or an external liquid crystal panel.

Reference numeral 4105 denotes an inclination sensor that detects theinclination of the video camera; an acceleration sensor is used as theinclination sensor in the present embodiment. Reference numeral 4106denotes an amplifier circuit that amplifies an output from theinclination sensor 4105.

Reference numeral 4112 denotes a camera system controlling microcomputerincluding a camera controlling part 4113 and a display controlling part4114. The camera controlling part 4113 controls the zoom driving source4102 and the focusing driving source 4104 to change the angle of viewand to perform focusing, respectively. The camera controlling part 4113also controls the drive of the CCD 4107, the AGC 4108 and camera signalprocessing circuit 4109. Further, the display controlling part 4114loads an output from the amplifier circuit 4106 and generates aninclination guide display signal corresponding to the detectedinclination. The display controlling part 4114 also determines whetheror not to provide an inclination guide display on the basis of the stateof a mode switch 4115 and a guide display ON/OFF switch 4117. To providethe inclination guide display, the display controlling part 4114 outputsthe inclination guide display signal to the display processing circuit4110. This enables the display processing circuit 4110 to synthesize theinclination guide display signal on a video signal to superimposedlydisplay an inclination guide 4403 in a picked-up image 4401 on a screenof the display device 4111.

Reference numeral 4115 denotes the mode switch that switches the imagepickup mode between a moving image pickup mode and a still image pickupmode. Reference numeral 4116 denotes a shutter button that is a two-stepswitch instructing a still image pickup operation to be performed inaccordance with its pressed position. Reference numeral 4117 denotes theguide display ON/OFF switch that enables the user to turn on and off theinclination guide display. The guide display ON/OFF switch 4117 may bean independent operation member or an item on a menu which can besubjected to a switching operation.

FIGS. 41A to 41C are diagrams showing the relationship between theinclination of the video camera and the output from the inclinationsensor 4105. In FIGS. 41A to 41C, reference numerals 4100, 4111, and4105 denote the video camera, the liquid crystal panel as the displaydevice, and the inclination sensor (acceleration sensor), respectively.Appropriately setting of the gain of the amplifier circuit 4106 in FIG.40 enables the sensor output from the inclination sensor 4105 to be setwithin the voltage range described below.

FIG. 41B shows that the video camera 4100 is at a regular position. Theoutput from the inclination sensor 4105 is equal to half of a powersupply voltage Vcc. In contrast, inclining the video camera 4100counterclockwise by 90° as shown in FIG. 41A provides the output fromthe inclination sensor 4105 equal to the power supply voltage Vcc.Conversely, inclining the video camera 4100 clockwise by 90° as shown inFIG. 41C provides the output from the inclination sensor 4105 at a GNDlevel.

For the inclinations between those shown in FIG. 41A and FIG. 41B andbetween those shown in FIG. 41B and FIG. 41C, the output from theinclination sensor 4105 changes linearly with the inclination. On thebasis of a voltage corresponding to the inclination, the displaycontrolling part 4114 generates the inclination guide display signalindicating the inclination. The inclination guide display signal issynthesized on the video signal via the display processing circuit 4110to superimposedly display the inclination guide 4403 in the picked-upimage 4401 on the screen of the display device 4111.

FIG. 42 is a flowchart illustrating the processing operation performedby the display controlling part 4114 in the camera system controllingmicrocomputer 4112 to display the inclination guide. In step S4301, theprocess determines whether or not the guide display ON/OFF switch 4117is on. If the guide display ON/OFF switch 4117 is off, the processreturns to a main routine without providing any output to the displayprocessing circuit 4110. In contrast, if the guide display ON/OFF switch4117 is on, the process proceeds to step S4302 to sample a sensor outputof the inclination sensor 4105, and then proceeds to step S4303.

In step S4303, the process checks the setting of the mode switch 4115 todetermine whether the image pickup mode is the moving image pickup modeor the still image pickup mode. In the moving image pickup mode, theprocess proceeds to step S4306 with the level of exaggeration of theinclination guide display set at the normal value. In contrast, in thestill image pickup mode, the process proceeds to step S4304.

In step S4304, the process determines whether or not the shutter button4116 is in a half pressed position. If the shutter button 4116 is in thehalf pressed position, the process proceeds to step S4305 to set theexaggeration of the inclination guide display at a higher level. This isan operation for exaggerating the inclination guide display. If theshutter button 4116 is not in the half pressed position, the processproceeds to step S4306 with the exaggeration of the inclination guidedisplay at the normal level.

Specifically, the level of exaggeration of the inclination guide displayis set by setting an exaggeration coefficient indicating the level ofexaggeration. The exaggeration coefficient is normally set to “1”.However, when the process determines in step S4304 that the shutterbutton 4116 is in the half pressed position, the exaggerationcoefficient is set to “1.5” in step S4305.

In step S4306, display angle data θ indicating an angle at which theinclination guide is displayed is calculated on the basis of the sensoroutput of the inclination sensor 4105 and the inclination sensitivityset as described above. The calculation is executed as follows:

=(exaggeration coefficient)×(sensor output).

The exaggeration coefficient used herein refers to the value set above,and the sensor output refers to the output from the amplifier circuit4106 loaded in step S4301. Further, the display angle data θ indicatesthe angle between the inclination guide 4403 and a horizontal line 4402shown in FIG. 43. The above equation enables the angle of theinclination guide 4403 to be exaggeratedly displayed in accordance withthe image pickup mode and the pressed position of the shutter button4116 even if the inclination sensor 4105 detects the same inclination.

After calculation of the display angle data θ, the process proceeds tostep S4307, where the display processing circuit 4110 executes adisplaying process and then displays the inclination guide on thedisplay device 4111.

In many applications, in the moving image pickup mode, the user picks upan image of a moving object with the video camera held by his or herhand while panning it for chasing the object. It is thus difficult forthe user to keep the camera horizontal. A sensitive movement of theinclination guide display may be cumbersome to the user. Further, in thestill image pickup mode, framing is performed except for the case wherethe shutter button 4116 is in the half pressed position. Thus,maintaining the normal setting without exaggerating the inclinationguide display makes it possible to prevent the user from feelinguncomfortable in operating the video camera.

In contrast, in the still image pickup mode, if the shutter button 4116is in the half pressed position, then in order to record that scene, theuser checks whether or not the composition is as intended, particularlywhether or not the object is inclined, and attempts to hold the camerahorizontal so as to avoid inclining the object. Thus, in this case, theinclination guide is displayed by exaggerating the inclination detectedby the inclination sensor 4105 by 1.5 times. This enables a slighterinclination to be presented to the user so that the user can more easilyrecognize it.

This configuration makes it possible to prevent a recorded image frombeing inclined and to eliminate the need for rotational correctionsduring reproduction of an inclined image. Moreover, if the shutterbutton 4116 is in the half pressed position, AF (auto focus), AE, andthe like are locked to reduce disadvantageous processing loads. Thisenables a smooth and sensitive inclination guide display.

Embodiment 15

Embodiment 15 of the present invention will be described. Theconfiguration of a video camera that is Embodiment 15 is similar to thatof Embodiment 14, and its detailed description is thus omitted.

FIG. 44 is a flowchart illustrating the display processing operationperformed by the display controlling part 4114 in the camera systemcontrolling microcomputer 4112 to display the inclination guide. In stepS4501, the process determines whether or not the guide display ON/OFFswitch 4117 is on. If the guide display ON/OFF switch 4117 is off, theprocess returns to the main routine without providing any output to thedisplay processing circuit 4110. In contrast, if the guide displayON/OFF switch 4117 is on, the process proceeds to step S4502 to samplethe sensor output of the inclination sensor 4105, and then proceeds tostep S4503.

In step S4503, the process checks the setting of the mode switch 4115 todetermine whether the image pickup mode is the moving image pickup modeor the still image pickup mode. In the moving image pickup mode, theprocess proceeds to step S4505 to set the sensitivity (the level ofexaggeration) of the inclination guide display at a lower level, andthen, the process proceeds to step S4506. In contrast, in the stillimage pickup mode, the process proceeds to step S4504.

In step S4504, the process determines whether or not the shutter button4116 is in the half pressed position. When the shutter button 4116 is inthe half pressed position, the process proceeds to step S4506 with theexaggeration coefficient for the inclination guide display kept at “1”,which is the normal value. If the shutter button 4116 is not in the halfpressed position, the process proceeds to step S4505 to set theexaggeration coefficient for the inclination guide display at “0.5” andthen proceeds to step S4506. This is an operation for making theinclination guide display unnoticeable.

Specifically, the level of exaggeration of the inclination guide displayis set by setting the exaggeration coefficient indicating the level ofexaggeration. The exaggeration coefficient is normally set to “1”.However, when the process determines in step S4304 that the image pickupmode is the moving image pickup mode or when the shutter button 4116 isnot in the half pressed position in the still image pickup mode, theexaggeration coefficient is set to “0.5” in step S4506.

In step S4506, display angle data θ indicating an angle at which theinclination guide is displayed is calculated on the basis of the sensoroutput from the inclination sensor 4105 and the inclination sensitivityset as described above. The calculation is executed as follows:

=(exaggeration coefficient)×(sensor output).

The exaggeration coefficient used herein refers to the value set above,and the sensor output refers to the output from the amplifier circuit4106 loaded in step S4501. Further, the display angle data θ indicatesthe angle between the inclination guide 4403 and the horizontal line4403 shown in FIG. 43. The above equation enables the angle of theinclination guide 4403 to be made unnoticeable in accordance with theimage pickup mode and the pressed position of the shutter button 4116even if the inclination sensor 4105 detects the same inclination.

After calculation of the display angle data θ, the process proceeds tostep S4507, where the display processing circuit 4110 executes adisplaying process and then displays the inclination guide on thedisplay device 4111.

In many applications, in the moving image pickup mode, the user picks upan image of a moving object with the video camera held by his or herhand while panning it for chasing the object. It is thus difficult forthe user to keep the camera horizontal. A sensitive movement of theinclination guide display may be cumbersome to the user. Further, in thestill image pickup mode, framing is performed except for the case wherethe shutter button 4116 is in the half pressed position. Thus, in thesecases, displaying the inclination guide at an angle smaller than theinclination detected by the inclination sensor 4105 makes it possible toprevent the user from feeling uncomfortable in operating the videocamera.

In contrast, in the still image pickup mode, if the shutter button 4116is in the half pressed position, then in order to record that scene, theuser checks whether or not the composition is as intended, particularlywhether or not the object is inclined, and attempts to hold the camerahorizontal so as to avoid inclining the object. Thus, in this case, theinclination guide is displayed at the inclination detected by theinclination sensor 4105. This enables a slighter inclination to bepresented to the user so that the user can more easily recognize it.

Embodiment 16

Embodiment 16 of the present invention will be described. As shown inFIG. 45, the basic configuration of the video camera that is Embodiment16 is similar to that shown in FIG. 40 except that the amplifier circuit4106 is replaced with a variable gain amplifier circuit 4118. Thevariable gain amplifier circuit 4118 changes the gain of the sensoroutput from the inclination sensor 4105. This enables a variation in thedetection sensitivity of an inclination detector constituted by theinclination sensor 4105 and the variable gain amplifier circuit 4118.The gain setting can be changed by an amplifier controlling part 4119provided in the camera system controlling microcomputer 4112, inaccordance with the state of the mode switch 4115 and the pressedposition of the shutter button 4116.

FIG. 47 is a diagram showing an example of configuration of the variablegain amplifier circuit 4118. The variable gain amplifier circuit 4118 isconstituted by an amplifier 4805, resistors 4804, and a gain switch4803. A switch signal from the camera system controlling microcomputer4112 connects input resistors in parallel with each other with respectto the amplifier 4805 to increase the gain of the amplifier 4805. Thegain change is effected in order to exaggerate the guide display for thefixed image pickup.

FIG. 46 is a flowchart illustrating the display processing operationperformed by the guide display controlling part 4114 and amplifiercontrolling part 4119 in the camera system controlling microcomputer4112 to display the inclination guide. In step S4701, the processdetermines whether or not the guide display ON/OFF switch 4117 is on. Ifthe guide display ON/OFF switch 4117 is off, the process returns to themain routine without providing any output to the display processingcircuit 4110. In contrast, if the guide display ON/OFF switch 4117 ison, the process proceeds to step S4702.

In step S4702, the process checks the setting of the mode switch 4115 todetermine whether the image pickup mode is the moving image pickup modeor the still image pickup mode. In the moving image pickup mode, theprocess proceeds to step S4705 with the gain of the variable gainamplifier circuit 4118 kept at a normal set value, that is, with thedetection sensitivity of the inclination detector kept at a normal setvalue. In contrast, in the still image pickup mode, the process proceedsto step S4703.

In step S4703, the process determines whether or not the shutter button4116 is in the half pressed position. If the shutter button 4116 is inthe half pressed position, the process proceeds to step S4704 toincrease the gain of the variable gain amplifier circuit 4118, that is,to set the detection sensitivity of the inclination detector at a higherlevel. This is an operation for exaggerating the inclination guidedisplay. If the shutter button 4116 is not in the half pressed position,the process proceeds to step S705 with the gain of the variable gainamplifier circuit 4118 kept at the normal set value, that is, with thedetection sensitivity of the inclination detector kept at the normal setvalue.

In step S4705, the sensor output of the inclination sensor 4105 issampled. In step S4706, the inclination guide is displayed on thedisplay device 4111 via the display processing circuit 4110.

In many applications, in the moving image pickup mode, the user picks upan image of a moving object with the video camera held by the user'shand while panning it for chasing the object. It is thus difficult forthe user to keep the camera horizontal. A sensitive movement of theinclination guide display may be cumbersome to the user. Further, in thestill image pickup mode, framing is performed except for the case wherethe shutter button 4116 is in the half pressed position. Thus, in thesecases, keeping the detection sensitivity of the inclination detector atthe normal set value, that is, a relatively small value, makes itpossible to prevent the user from feeling uncomfortable in operating thevideo camera.

In contrast, in the still image pickup mode, if the shutter button 4116is in the half pressed position, then in order to record that scene, theuser checks whether or not the composition is as intended, particularlywhether or not the object is inclined, and attempts to hold the camerahorizontal so as to avoid inclining the object. Thus, in this case,setting the detection sensitivity of the inclination detector at ahigher level enables a slighter inclination to be presented to the userso that the user can more easily recognize it.

This configuration makes it possible to prevent a recorded image frombeing inclined and to eliminate the need for rotational correctionsduring reproduction of an inclined image. Moreover, if the shutterbutton 4116 is in the half pressed position, AF (auto focus), AE, andthe like are locked to reduce disadvantageous processing loads. Thisenables a smooth and sensitive inclination guide display.

Embodiment 17

Embodiment 17 of the present invention will be described. Theconfiguration of a video camera that is Embodiment 17 is similar to thatin Embodiment 16 and its detailed description is thus omitted.

FIG. 49 is a diagram showing an example of configuration of the variablegain amplifier circuit 4118. The variable gain amplifier 4118 isconstituted by an amplifier 4003, resistors 4005, and a gain switch4004. A switch signal from the camera system controlling microcomputer4112 connects feedback resistors in parallel with each other withrespect to the amplifier 4003 to decrease the gain of the amplifier4003. The gain change is effected in order to make the inclination guidedisplay unnoticeable.

FIG. 48 is a flowchart illustrating the display processing operationperformed by the guide display controlling part 4114 and amplifiercontrolling part 4119 in the camera system controlling microcomputer4112 to display the inclination guide. In step S4901, the processdetermines whether or not the guide display ON/OFF switch 4117 is on. Ifthe guide display ON/OFF switch 4117 is off, the process returns to themain routine without providing any output to the display processingcircuit 4110. In contrast, if the guide display ON/OFF switch 4117 ison, the process proceeds to step S4902.

In step S4902, the process checks the setting of the mode switch 4115 todetermine whether the image pickup mode is the moving image pickup modeor the still image pickup mode. In the moving image pickup mode, theprocess proceeds to step S4904 to reduce the gain of the variable gainamplifier circuit 4118, that is, to set the detection sensitivity of theinclination detector at a lower level. The process then proceeds to stepS4905. In contrast, in the still image pickup mode, the process proceedsto step S4903.

In step S4903, the process determines whether or not the shutter button4116 is in the half pressed position. If the shutter button 4116 is inthe half pressed position, the process proceeds to step S4905 with thegain of the variable gain amplifier circuit 4118 kept at the normal setvalue, that is, with the detection sensitivity of the inclinationdetector kept at the normal set value. If the shutter button 4116 is notin the half pressed position, the process proceeds to step S4904 toreduce the gain of the variable gain amplifier circuit 4118, that is, toset the detection sensitivity of the inclination detector at a smallervalue. This is an operation for making the inclination guide displayunnoticeable.

In step S4905, the sensor output from the inclination sensor 4105 issampled. In step S4906, the inclination guide is displayed on thedisplay device 4111 via the display processing circuit 4110.

In many applications, in the moving image pickup mode, the user picks upan image of a moving object with the video camera held by his or herhand while panning it for chasing the object. It is thus difficult forthe user to keep the camera horizontal. A sensitive movement of theinclination guide display may be cumbersome to the user. Further, in thestill image pickup mode, framing is performed except for the case wherethe shutter button 4116 is in the half pressed position. Thus, in thesecases, setting the detection sensitivity of the inclination detector ata smaller value makes it possible to prevent the user from feelinguncomfortable in operating the video camera.

In contrast, in the still image pickup mode, if the shutter button 4116is in the half pressed position, then in order to record that scene, theuser checks whether or not the composition is as intended, particularlywhether or not the object is inclined, and attempts to hold the camerahorizontal so as to avoid inclining the object. Thus, in this case,keeping the detection sensitivity of the inclination detector at thenormal set value, that is, a relatively large value, enables a slighterinclination to be presented to the user so that the user can more easilyrecognize it.

Embodiment 18

FIG. 50 is a block diagram showing the configuration of a video camerathat is Embodiment 18 of the present invention. In FIG. 50, referencenumeral 5101 denotes a lens unit used to pick up an image of an object.Reference numeral 5102 denotes a CCD that photoelectrically converts anobject image formed by the lens unit 5101 into an analog image pickupsignal.

Reference numeral 5104 denotes a camera signal processing circuit thatuses a built-in A/D converter to covert the analog image pickup signalfor the object image provided by the CCD 5102 into a digital signal andexecutes predetermined signal processing such as gamma correction andwhite balancing on the digital signal to generate a standard videosignal.

Reference numeral 5107 denotes an inclination sensor that detects aninclination of the video camera 5100; an acceleration sensor is used forthe inclination sensor in the present embodiment. Reference numeral 5108denotes an amplifier circuit that amplifies an output from theinclination sensor 107. Reference numeral 5112 denotes a guide displaygenerating circuit that generates an inclination guide display signalcorresponding to an inclination signal from the inclination sensor 5107and amplifier circuit 5108.

Reference numeral 5105 denotes a display superimposing circuit thatsuperimposes the inclination guide display signal provided by the guidedisplay generating circuit 5112 on the standard video signal provided bythe camera signal processing circuit 5104 to simultaneously display themon a viewfinder 5106.

Reference numeral 5131 denotes an image pickup mode switch operated by auser according to his or her image pickup intention to switch between astill image pickup mode and a moving image pickup mode.

Reference numeral 5120 denotes a tape recorder in which the standardvideo signal processed by the camera signal processing circuit 5104 isrecorded. Reference numeral 5121 denotes a memory card in which astandard still image signal processed by the camera signal processingcircuit 5104 is recorded.

Reference numeral 5109 denotes a microcomputer that controls the driveof the CCD 5102, the camera signal processing circuit 5104 and the likein accordance with the operation of the image pickup mode switch 5131 toswitch the method for signal processing between still image processingand moving image processing. The microcomputer also controls the systemso that a moving image is recorded in the tape recorder 5120, while astill image is recorded in the memory card 5121. The microcomputerfurther controls the display superimposing circuit 5105.

Reference numeral 5106 denotes the viewfinder that displays an imagegenerated by superimposing the inclination guide display signal on thestandard video signal by the display superimposing circuit 5105.

Next, the operation of each part will be described. First, an objectimage formed by the lens unit 5101 is photoelectrically converted by theCCD 5102, and the converted image is further converted into a digitalsignal by the camera signal processing circuit 5104. Predeterminedsignal processing such as gamma correction and white balancing isexecuted on the digital signal. As a result, the standard video signalis output and transmitted to the tape recorder 5120 and memory card5121.

On the other hand, the inclination signal provided by the inclinationsensor 5107 is subjected to predetermined amplification by the amplifiercircuit 5108. The guide display generating circuit 5112 outputs theinclination guide signal corresponding to the inclination signal. Thedisplay superimposing circuit 5105 superimposes the inclination guidedisplay signal on the standard video signal, and the resulting signal isdisplayed on the viewfinder 5106.

Next, description will be given of a process involved in switching ofthe image pickup mode. First, description will be given of the casewhere the image pickup mode switch 5131 is switched to select the stillimage pickup mode.

Selection of the still image pickup mode enables the microcomputer 5109to control reading of all the pixels in the CCD 5102 and also switchesthe camera signal processing circuit 5104 to a state of performing thestill image processing. At the same time, the memory card 5121 isselected as a recording medium.

Moreover, switching of the image pickup mode switch 5131 causes adisplay superimposition control signal to be transmitted to the displaysuperimposing circuit 5105 via the microcomputer 5109. The displaysuperimposing circuit 5105 performs or stops the superimposition of theguide display signal generated by the guide display generating circuit5112 on the standard video signal provided by the camera signalprocessing circuit 5104, in accordance with the display superimpositioncontrol signal. Accordingly, if the still image pickup mode is selectedby the image pickup mode switch 5131, the display superimposing circuit5105 is enabled to provide an inclination guide display.

Next, description given of the case where the image pickup mode switch5131 is switched to select the moving image pickup mode.

Selection of the moving image pickup mode enables the microcomputer 5109to control reading of the moving image area in the CCD 5102 and alsoswitches the camera signal processing circuit 104 to a state ofperforming the moving image processing. At the same time, the taperecorder 5120 is selected as a recording medium.

Moreover, if the moving image pickup mode is selected by the imagepickup mode switch 5131, the display superimposing circuit 5105prohibits the provision of the inclination guide display.

Next, processing executed by the microcomputer 5109 will be describedwith reference to FIG. 51. FIG. 51 is a flowchart associated with theoperation of the microcomputer 5109 for switching the image pickup mode.

FIG. 51 will be sequentially described. The flow starts at step S5201,and the flow is repeatedly performed at a predetermined periodcorresponding to, for example, video synchronization.

In step S5202, the image pickup mode selected via the image pickup modeswitch 5131 is checked. If the image pickup mode is set to the stillimage pickup mode, the process proceeds to step S5203. If the imagepickup mode is set to the moving image pickup mode, the process proceedsto step S5204.

First, description will be given of the case where the still imagepickup mode is selected as the image pickup mode. In step S5203, theselection of the still image pickup mode sets the reading mode of theCCD 5102 to an all-pixel still image reading mode.

Then, in step S5205, signal processing executed by the camera signalprocessing circuit 5104 is similarly switched to the still image signalprocessing. Specifically, an analog image signal read from the CCD 5102is analog-to-digital converted to generate still image data. Theconverted digital signal is then subjected to predetermined signalprocessing such as still image gamma correction and white balancing.Then, standard still image data is generated at every predeterminedtiming such as the video synchronization.

Then, in step S5207, the memory card 5121 is selected as a recordingmedium.

Then, in step 5209, the output of the inclination guide display ispermitted, and the display superimposing circuit 5105 performs asuperimposing operation. An image signal produced by superimposing theinclination guide display on the standard video signal is transmitted tothe viewfinder 5106 for display.

Then, in step S5211, the process determines whether or not the shutterbutton (not shown) has been pressed. If the shutter button has beenpressed, the process proceeds to step S5213. If the shutter button hasnot been pressed, the process proceeds to step S5220 and then ends.

If the shutter button has been pressed, then in step S5213, an imagepicked up at that time is recorded in the memory card 5121. The processproceeds to step S5220 and then ends.

If the above process selects the still image pickup mode, theinclination guide display is displayed on the viewfinder 5106.

Next, description will be given of the case where the moving imagepickup mode is selected as the image pickup mode in step S5202.

First, in step S5204, since the moving image pickup mode is selected asthe image pickup mode, the reading mode of the CCD 5102 is set to amoving image reading mode.

Then, in step S5206, the signal processing by the camera signalprocessing circuit 5104 is also switched to the moving image signalprocessing. Specifically, the analog image signal read from the CCD 5102is analog-to-digital converted to generate moving image data. Theconverted digital signal is then subjected to predetermined signalprocessing such as moving image gamma correction and white balancing togenerate the standard video signal at every predetermined timing such asstandard video synchronization.

In step S5208, the tape recorder 5120 is selected as a recording medium.

In step S5210, the output of the inclination guide display is prohibitedto stop the superimposing operation of the display superimposing circuit5105. The standard video signal is transmitted to and displayed on theviewfinder 5106 as it is.

In step S5212, the process determines whether or not a trigger switch(not shown) has been pressed. If the trigger switch has been pressed,the process proceeds to step S5214. If the trigger switch has not beenpressed, the process proceeds to step S5220 and then ends.

If the trigger switch has been pressed, then the process determines instep S5214 whether or not moving image recording is being performed. Ifthe moving image recording is being performed, the process proceeds tostep S5215. If the moving image recording is not being performed, theprocess proceeds to step S5216.

If the moving image recording is being performed, then in step S5215,the moving image recording is stopped in response to the operation ofthe trigger switch.

If the moving image recording is not being performed, then in stepS5216, the moving image recording is started in response to theoperation of the trigger switch.

According to the above processes, if the moving image pickup mode isselected, the inclination guide display is not displayed on theviewfinder 106, with only the picked-up image displayed on theviewfinder 106.

FIGS. 52A to 52C are diagrams showing the relationship between theinclination of the video camera 5100 and the output of the inclinationsensor 5107 (acceleration sensor). In FIGS. 52A to 52C, referencenumerals 5100, 5106, and 5107 denote the video camera, the viewfinder asthe display device, and the inclination sensor (acceleration sensor)respectively. Appropriately setting of the gain of the amplifier circuit5108 makes it possible to set the output from the inclination sensor5107 to have the voltage range described below.

FIG. 52B shows that the video camera is at a regular position. In thisstate, the output of the inclination sensor 5107 is equal to about halfof a power supply voltage Vcc. In contrast, inclining the video camera5100 clockwise by 90° as shown in FIG. 52A provides the output of theinclination sensor 5107 close to the power supply voltage Vcc.Conversely, inclining the video camera 5100 counterclockwise by 90° asshown in FIG. 52C provides the output of the inclination sensor 5108close to a GND level.

For the inclinations between those shown in FIG. 52A and FIG. 52B andbetween those shown in FIG. 52B and FIG. 52C, the output of theinclination sensor 5108 changes linearly with the inclination. Thiscauses the guide display generating circuit 5112 to generate an imageindicating the inclination on the basis of the voltage corresponding tothe inclination. The image is synthesized on the standard video signalvia the display superimposing circuit 5105. The synthesized image isdisplayed on the viewfinder 5106.

The image displayed on the viewfinder 5106 will be described withreference to FIG. 53. FIG. 53 shows an example in which the inclinationguide display is shown on the viewfinder 5106 when the still imagerecording mode is set.

In FIG. 53, reference numeral 5301 denotes the inclination guide displaygenerated by the guide display generating circuit 5112. The inclinationamount shown by the inclination guide display changes depending on theinclination signal from the inclination sensor 5107. In this case,appropriately adjusting the gain of the amplifier circuit 5108 aspreviously described enables the inclination to be set to “A′”, which isapproximately equal to the object's inclination (for example, aninclination “A” with respect to the background horizon).

As described above, the video camera 5100 as Embodiment 18 of thepresent invention shows the inclination guide display in the still imagepickup mode and not in the moving image pickup mode. This makes itpossible to urge the user to make the inclination of the video camera5100 unnoticeable in the still image pickup mode and to prevent user'smoving image pickup from being disturbed in the moving image pickupmode.

Embodiment 19

Next, Embodiment 19 of the present invention will be described. Theconfiguration of Embodiment 19 provides the inclination guide displayboth in the still image pickup mode and in the moving image pickup mode.In this case, in particular, when the image pickup mode is switched tothe still image pickup mode, the inclination of the guide displayrelative to the inclination of the image pickup apparatus is increasedto improve visibility for the user.

Embodiment 19 will be described with reference to FIG. 54. FIG. 54 is ablock diagram showing the configuration of a video camera 5200 that isEmbodiment 19. The configuration of the video camera of Embodiment 19 isgenerally similar to that in Embodiment 18. Components of Embodiment 19common to those in Embodiment 18 will not be described.

First, description will be given of the difference between the videocamera 5200 of Embodiment 19 and the video camera 5100 of Embodiment 18.

The video camera 5200 of Embodiment 19 contains a microcomputer 5509that controls the gain of an amplifier circuit 5508. Like the amplifiercircuit 5108 of Embodiment 18, the amplifier circuit 5508 can amplifythe output of the inclination sensor 5107 and further change the gain inaccordance with an external control signal.

Next, description will be given of processes executed in associationwith switching of the image pickup mode by the configuration having theamplifier circuit 5508 and being able to control the gain. First,description will be given of the case where the image pickup mode switch5131 is switched to select the still image pickup mode.

Selection of the still image pickup mode enables the microcomputer 5509to control reading of all the pixels in the CCD 5102 and to also switchthe camera signal processing circuit 5104 to a state of performing stillimage processing. At the same time, the memory card 5121 is selected asa recording medium.

Moreover, in response to switching of the image pickup mode switch 5131,the gain of the amplifier circuit 5508 is switched to a predeterminedvalue for still image pickup via the microcomputer 5509.

The display superimposing circuit 5105 further superimposes the guidedisplay signal generated by the guide display generating circuit 5112 onthe standard video signal provided by the camera signal processingcircuit 5104 to show the inclination guide display in the viewfinder5106.

Next, description will be given of the case where the image pickup modeswitch 5131 is switched to select the moving image pickup mode.

Selection of the moving image pickup mode enables the microcomputer 5509to control reading from the moving image area of the CCD 5102 and toalso switch the camera signal processing circuit 5104 to a state ofperforming moving image processing. At the same time, the tape recorder5120 is selected as a recording medium.

Moreover, the gain of the amplifier circuit 5508 is changed to one formoving image pickup. The display superimposing circuit 5105 superimposesthe guide display signal generated by the guide display generatingcircuit 5112 on the standard video signal provided by the camera signalprocessing circuit 5104 to show the inclination guide display in theviewfinder 5106.

Here, when for example, the gain of the amplifier circuit 5508 in thestill image pickup mode is double that in the moving image pickup mode,then even with the same inclination, the inclination guide display shownon the viewfinder 5106 has a double inclination in the still imagepickup mode.

With reference to FIG. 55, description will be given of processesexecuted by the microcomputer 5509 in Embodiment 19. FIG. 55 shows aflowchart of the operation performed by the microcomputer 5509 forswitching the image pickup mode.

FIG. 55 will be sequentially described. The flow starts at step S5601,and the flow is repeated at a predetermined period corresponding to, forexample, the video synchronization.

In step S5602, the image pickup mode selected via the image pickup modeswitch 5131 is checked. If the image pickup mode is set to the stillimage pickup mode, the process proceeds to step S5603. If the imagepickup mode is set to the moving image pickup mode, the process proceedsto step S5604.

First, description will be given of the case where the still imagepickup mode is selected as the image pickup mode.

In step S5603, since the still image pickup mode is selected as theimage pickup mode, the reading mode of the CCD 5102 is set to theall-pixel still image reading mode.

Then, in step S5605, signal processing executed by the camera signalprocessing circuit 5104 is also switched to the still image signalprocessing. Specifically, the analog image signal read from the CCD 5102is analog-to-digital converted to generate still image data. Theconverted digital signal is then subjected to predetermined signalprocessing such as still image gamma correction and white balancing togenerate standard still image data at every predetermined timing such asthe video synchronization.

In step S5607, the memory card 5121 is selected as a recording medium.

In step S5609, the microcomputer 5109 doubles the gain of the amplifiercircuit 5508 (compared to that in the moving image pickup mode) toincrease the inclination of the inclination guide display. An imagesignal containing the inclination guide display superimposed on thestandard video signal is transmitted to and displayed on the viewfinder5106.

Then, in S5611, the process determines whether or not the shutter button(not shown) has been pressed. If the shutter button has been pressed,the process proceeds to S5613. If the shutter button has not beenpressed, the process proceeds to S5620 and then ends.

If the shutter button has been pressed, then in step S5613, the currentpicked-up image is recorded in the memory card 5121. The process thenproceeds to step 5620 and then ends.

The above process enables the inclination guide display to be shown onthe viewfinder 5106 when the still image pickup mode is selected.

Next, description will be given of the case where the moving imagepickup mode is selected as the image pickup mode in step S5602.

First, in step S5604, since the moving image pickup mode is selected asthe image pickup mode, the reading mode of the CCD 5102 is set to themoving image reading mode.

Then, in step S5606, signal processing executed by the camera signalprocessing circuit 5104 is also switched to the moving image signalprocessing. Specifically, the analog image signal read from the CCD 5102is analog-to-digital converted to generate moving image data. Theconverted digital signal is then subjected to predetermined signalprocessing such as moving image gamma correction and white balancing togenerate the standard video signal at every predetermined timing such asthe standard video synchronization.

In step S5608, the tape recorder 5120 is selected as a recording medium.

Next, in step S5610, the gain of the amplifier circuit 5508 is changedback to a normal value to adjust the inclination of the inclinationguide display to the value of the actual inclination. The inclinationguide display is then superimposed on the standard video signal, whichis then transmitted to and displayed on the viewfinder 5106.

In step S5612, the process determines whether or not the trigger switch(not shown) has been pressed. If the trigger switch has been pressed,the process proceeds to step S5614. If the trigger switch has not beenpressed, the process proceeds to step S5620 and then ends.

If the trigger switch has been pressed, then the process determines instep S5614 whether or not the moving image pickup is being performed. Ifthe moving image pickup is being performed, the process proceeds to stepS5615. If the moving image recording is not being performed, the processproceeds to step S5616.

If the moving image recording is being performed, then in step S5615,the moving image recording is stopped in response to the operation ofthe trigger switch.

If the moving image recording is not being performed, then in stepS5616, the moving image recording is started in response to theoperation of the trigger switch.

The above process enables the inclination guide display with anincreased sensitivity to be displayed on the viewfinder 5106 if thestill image pickup mode is selected. That is, the inclination guidedisplay can show an inclination larger than the actual one.

The relationship between the inclination of the video camera 5200 andthe output of the inclination sensor 5107 (acceleration sensor) isequivalent to that described above in Embodiment 18 with reference toFIGS. 52A to 52C.

The image displayed on the viewfinder 5106 will be described withreference to FIGS. 56A and 56B. FIG. 56A shows an example in which theinclination guide display is shown on the viewfinder 5106 when the stillimage recording mode is set.

In FIG. 56A, reference numeral 5701 denotes the inclination guidedisplay generated by the guide display generating circuit 5112. Theinclination of the inclination guide display 5701 changes depending onthe inclination signal from the inclination sensor 5107. When the stillimage pickup mode is set as shown in FIG. 56A, the inclination of theinclination guide display 5701, denoted by “B”, is double that of theobject (for example, the inclination “A” from the background horizon).This improves visibility for the user.

If the moving image pickup mode is set as shown in FIG. 56B, theinclination of the inclination guide display 5701′ is set to “A′”, whichis the same as the inclination “A” as is the case with Embodiment 18.

As described above, the video camera 5200 of Embodiment 19 of thepresent invention provides the inclination guide display with aninclination larger than the actual one in the still image pickup mode toincrease the visibility compared to that in the moving image pickupmode. This enables the inclination of the video camera 5200 to bedisplayed in the still image pickup mode so that the user can easilyrecognize it and in the moving image pickup mode so as not to disturbuser's moving image pickup.

Embodiment 20

Next, Embodiment 20 of the present invention will be described. Theconfiguration in Embodiment 20 provides the inclination guide displayboth in the still image pickup mode and in the moving image pickup mode.In this case, in particular, when the image pickup mode is switched tothe still image pickup mode, the display color or form of theinclination guide display for the inclination of the image pickupapparatus is changed to improve visibility for the user.

Embodiment 20 will be described with reference to FIG. 57. FIG. 57 is ablock diagram showing the configuration of a video camera 5300 that isEmbodiment 20. The configuration of the video camera that is Embodiment20 is generally similar to that in Embodiment 18. Components ofEmbodiment 20 common to those in Embodiment 18 will not be described.

First, description will be given of the difference between the videocamera 5300 of Embodiment 20 and the video camera 5100 of Embodiment 18.

The video camera 5300 of Embodiment 20, a guide display generatingcircuit 5812 that generates the inclination guide display correspondingto the input inclination signal has a function of changing color orcharacter shape of the inclination guide display in accordance with acontrol signal from a microcomputer 5809.

Description will be given of processes executed by the configurationhaving the guide display generating circuit 5812 and microcomputer 5809in association with switching of the image pickup mode. First,description will be given of the case where the image pickup mode switch5131 is switched to select the still image pickup mode.

Selection of the still image pickup mode enables the microcomputer 5809to control reading of all the pixels in the CCD 5102 and to also switchthe camera signal processing circuit 5104 to a state of performing thestill image processing. At the same time, the memory card 5121 isselected as a recording medium.

Moreover, in response to switching of the image pickup mode switch 5131,a change is made to the color or character shape of the inclinationguide display generated by the guide display generating circuit 5812through the microcomputer 5809. The change may be made by predeterminedstoring two colors or character shapes and switching one of the colorsor character shapes in accordance with the control signal from themicrocomputer 5809.

Then, the display superimposing circuit 5105 superimposes the guidedisplay signal generated by the guide display generating circuit 5812 onthe standard video signal provided by the camera signal processingcircuit 5104 to show the inclination guide display in the viewfinder5106.

Next, description will be given of the case where the image pickup modeswitch 5131 is switched to select the moving image pickup mode.

Selection of the moving image pickup mode enables the microcomputer 5809to control reading from the moving image area of the CCD 5102 and toalso switch the camera signal processing circuit 5104 to a state ofperforming the moving image processing. At the same time, the taperecorder 5120 is selected as a recording medium.

Moreover, the color of the inclination guide display generated by theguide display generating circuit 5812 or the character shape of theinclination guide display is changed back to a normal one.

Then, the display superimposing circuit 5105 superimposes the guidedisplay signal generated by the guide display generating circuit 5812 onthe standard video signal provided by the camera signal processingcircuit 5104 to show the inclination guide display in the viewfinder5106.

Processes executed by the microcomputer 5809 will be described withreference to FIG. 58. FIG. 58 shows a flowchart of the operationperformed by the microcomputer 5809 for switching the image pickup mode.

FIG. 58 will be sequentially described. The flow starts at step S5901,and the flow is repeated at a predetermined period corresponding to, forexample, the video synchronization.

In step S5902, the image pickup mode selected via the image pickup modeswitch 5131 is checked. If the image pickup mode is set to the stillimage pickup mode, the process proceeds to step S5903. If the imagepickup mode is set to the moving image pickup mode, the process proceedsto step S5904.

First, description will be given of the case where the still imagepickup mode is selected as the image pickup mode.

In step S5903, since the still image pickup mode is selected as theimage pickup mode, the reading mode of the CCD 5102 is set to theall-pixel still image reading mode.

Then, in step S5905, signal processing executed by the camera signalprocessing circuit 5104 is also switched to the still image signalprocessing. Specifically, the analog image signal read from the CCD 5102is analog-to-digital converted to generate still image data. Theconverted digital signal is then subjected to predetermined signalprocessing such as still image gamma correction and white balancing togenerate standard still image data at every predetermined timing such asthe video synchronization.

In step S5907, the memory card 5121 is selected as a recording medium.

Then, in S5909, the microcomputer 5809 changes the color or charactershape of the inclination guide display provided by the guide displaygenerating circuit 5812 and then superimposes the inclination guidedisplay on the standard video signal to obtain an image signal. Themicrocomputer 5809 then transmits the image signal to and displays it onthe viewfinder 5106.

The process then determines in step S5911 whether or not the shutterbutton (not shown) has been pressed. If the shutter button has beenpressed, the process proceeds to S5913. If the shutter button has notbeen pressed, the process proceeds to S5920 and then ends.

If the shutter button has been pressed, then in step S5913, the currentpicked-up image is recorded in the memory card 5121. The processproceeds to step 5920 and then ends.

The above process enables the inclination guide display to be shown onthe viewfinder 5106 when the still image pickup mode is selected.

Next, description will be given of the case where the moving imagepickup mode is selected as the image pickup mode in step S5902.

First, in step S5904, since the moving image pickup mode is selected asthe image pickup mode, the reading mode of the CCD 5102 is set to themoving image reading mode.

Then, in step S5906, signal processing executed by the camera signalprocessing circuit 5104 is also switched to the moving image signalprocessing. Specifically, the analog image signal read from the CCD 5102is analog-to-digital converted to generate moving image data. Theconverted digital signal is then subjected to predetermined signalprocessing such as moving image gamma correction and white balancing togenerate the standard video signal at every predetermined timing such asthe standard video synchronization.

In step S5908, the tape recorder 5120 is selected as a recording medium.

In step S5910, the microcomputer 5809 instructs the guide displaygenerating circuit 5812 to change the color or character shape of theinclination guide display generated thereby back to the normal one. Themicrocomputer 5809 superimposes the inclination guide display on thestandard video signal, transmits the resulting signal to and displays iton the viewfinder 5106.

In step S5912, the process determines whether or not the trigger switch(not shown) has been pressed. If the trigger switch has been pressed,the process proceeds to step S5914. If the trigger switch has not beenpressed, the process proceeds to step S5920 and then ends.

If the trigger switch has been pressed, then the process determines instep S5914 whether or not the moving image pickup is being performed. Ifthe moving image pickup is being performed, the process proceeds to stepS5915. If the moving image recording is not being performed, the processproceeds to step S5916.

If the moving image recording is being performed, then in step S5915,the moving image recording is stopped in response to the operation ofthe trigger switch.

If the moving image recording is not being performed, then in stepS5916, the moving image recording is started in response to theoperation of the trigger switch.

The above process enables, when the still image pickup mode is selected,the inclination guide display whose color or character shape is changedto be displayed on the viewfinder 5106.

The relationship between the inclination of the video camera 5300 andthe output of the inclination sensor 5107 (acceleration sensor) isequivalent to that described above in Embodiment 18 with reference toFIGS. 52A to 52C.

The image displayed on the viewfinder 5106 will be described withreference to FIG. 59. FIG. 59 shows an example in which the inclinationguide display is shown on the viewfinder 5106 when the still imagepickup mode is set.

In FIG. 59, reference numeral 5001 denotes the inclination guide displaygenerated by the guide display generating circuit 5812 and enabling theinclination to be clearly viewed in accordance with the control signalfrom the microcomputer 5809 compared to the inclination guide displaysshown in Embodiments 18 and 19. That is, in this example, theinclination guide display is thicker and has arrows; it is exaggeratedlydisplayed.

The character shape of the inclination guide display is not limited tothe one shown in FIG. 59. Any shape may be used which can provide ahigher visibility when the image pickup mode is switched to the stillimage pickup mode. Similarly, any color may be used which can provide ahigher visibility when the image pickup mode is switched to the stillimage pickup mode.

As described above, the video camera 5300 of Embodiment 20 of thepresent invention provides the inclination guide display with a highervisibility in the still image pickup mode than in the moving imagepickup mode by changing the shape or the like of the inclination guidedisplay. This enables the inclination of the video camera 5300 to bedisplayed in the still image pickup mode so that the user can easilyrecognize it and in the moving image pickup mode so as not to disturbuser's moving image pickup.

Embodiment 21

Next, Embodiment 21 of the present invention will be described. Theconfiguration in Embodiment 21 provides the inclination guide displayboth in the still image pickup mode and in the moving image pickup mode.In this case, in particular, the responsiveness of the guide display ischanged between the still image pickup mode and the moving image pickupmode to reduce the complicatedness of the image displayed on theviewfinder during moving image pickup.

Embodiment 21 will be described with reference to FIG. 60. FIG. 60 is ablock diagram showing the configuration of a video camera 5400 that isEmbodiment 21. The configuration of the video camera 5400 of Embodiment21 is generally similar to that of Embodiment 18. Components ofEmbodiment 21 common to those in Embodiment 18 will not be described.

First, description will be given of the difference between the videocamera 5400 of Embodiment 21 and the video camera 5100 of Embodiment 18.

The video camera 5400 of Embodiment 21 internally has a low pass filter5132 (hereinafter referred to as an LPF) and a switch 5133. The LPF 5132limits the frequency band of the inclination signal amplified by theamplifier circuit 5108. The switch 5133 switches between the outputsignal from the amplifier circuit 5108 and an output signal output fromthe amplified circuit 5108 and processed by the LPF 5132 so that one ofthe output signals is input to a guide display generating circuit 5112a, in accordance with a control signal from a microcomputer 5109 a.

The LPF 5132 executes band limiting processing on the inclination signalprovided by the inclination sensor 5107 and amplified by the amplifiercircuit 5108 by a predetermined amount. The band-limited inclinationsignal is then input to the guide display generating circuit 5112 a viathe switch 5133. The guide display generating circuit 5112 a outputs aninclination guide display signal corresponding to the band-limitedinclination signal. The inclination guide signal is superimposed on thestandard video signal by the display superimposing circuit 5105 toprovide the inclination guide display on the viewfinder 5106.

Next, description will be given of processes executed by theconfiguration in Embodiment 21 in association with switching of theimage pickup mode. First, description will be given of the case wherethe image pickup mode switch 5131 is switched to select the still imagepickup mode.

Selection of the still image pickup mode enables the microcomputer 5109a to control reading of all the pixels in the CCD 5102 and to alsoswitch the camera signal processing circuit 5104 to a state ofperforming the still image processing. At the same time, the memory card5121 is selected as a recording medium.

Moreover, in response to switching of the image pickup mode switch 5131,the switch 5133 selects the amplifier circuit 5108 side via themicrocomputer 5109 a. That is, the inclination signal amplified by theamplifier circuit 5108 is applied to the guide display generatingcircuit 5112 a.

The display superimposing circuit 5105 superimposes the guide displaysignal generated by the guide display generating circuit 5112 a on thestandard video signal provided by the camera signal processing circuit5104 to show the inclination guide display on the viewfinder 5106.

Next, description will be given of the case where the image pickup modeswitch 5131 is switched to select the moving image pickup mode.

Selection of the moving image pickup mode enables the microcomputer 5109a to control reading from the moving image area of the CCD 5102 and toalso switch the camera signal processing circuit 5104 to a state ofperforming the moving image processing. At the same time, the taperecorder 5120 is selected as a recording medium.

Moreover, in response to switching of the image pickup mode switch 5131,the switch 5133 selects the LPF 5132 side via the microcomputer 5109 a(the state shown in FIG. 60). That is, the inclination signal that hasbeen amplified by the amplifier circuit 5108 and whose high frequencyband has been limited by the LPF 5132 is applied to the guide displaygenerating circuit 5112 a.

The display superimposing circuit 5105 superimposes the guide displaysignal generated by the guide display generating circuit 5112 a on thestandard video signal provided by the camera signal processing circuit5104 to show the inclination guide display in the viewfinder 5106.

Processes executed by the microcomputer 5109 a will be described withreference to FIG. 61. FIG. 61 shows a flowchart of the operation of themicrocomputer 5109 a for switching the image pickup mode

FIG. 61 will be sequentially described. The flow starts at step S5301,and the flow is repeated at a predetermined period corresponding to, forexample, the video synchronization.

In step S5302, the image pickup mode selected via the image pickup modeswitch 5131 is checked. If the image pickup mode is set to the stillimage pickup mode, the process proceeds to step S5303. If the imagepickup mode is set to the moving image pickup mode, the process proceedsto step S5304.

First, description will be given of the case where the still imagepickup mode is selected as the image pickup mode.

In step S5303, since the still image pickup mode is selected as theimage pickup mode, the reading mode of the CCD 5102 is set to theall-pixel still image reading mode.

Then, in step S5305, signal processing executed by the camera signalprocessing circuit 5104 is also switched to the still image signalprocessing. Specifically, the analog image signal read from the CCD 5102is analog-to-digital converted to generate still image data. Theconverted digital signal is then subjected to predetermined signalprocessing such as still image gamma correction and white balancing togenerate standard still image data at every predetermined timing such asthe video synchronization.

In step S5307, the memory card 5121 is selected as a recording medium.

Then, in step S5309, the microcomputer 5109 a causes the switch 5133 toselect the output of the amplifier circuit 5108. Thereby, an imagesignal that contains the inclination guide display superimposed on thestandard video signal and whose frequency band is not limited istransmitted to and displayed on the viewfinder 5106.

The process then determines in step S5311 whether or not the shutterbutton (not shown) has been pressed. If the shutter button has beenpressed, the process proceeds to S5313. If the shutter button has notbeen pressed, the process proceeds to S5320 and then ends.

If the shutter button has been pressed, then in step S5313, the currentpicked-up image is recorded in the memory card 5121. The process thenproceeds to step 5320 and ends.

The above process enables the inclination guide display to be shown onthe viewfinder 5106 when the still image pickup mode is selected.

Next, description will be given of the case where the moving imagepickup mode is selected as the image pickup mode in step S5302.

First, in step S5304, since the moving image pickup mode is selected asthe image pickup mode, the reading mode of the CCD 5102 is set to themoving image reading mode.

Then, in step S5306, signal processing executed by the camera signalprocessing circuit 5104 is also switched to the moving image signalprocessing. Specifically, the analog image signal read from the CCD 5102is analog-to-digital converted to generate moving image data. Theconverted digital signal is then subjected to predetermined signalprocessing such as moving image gamma correction and white balancing togenerate the standard video signal at every predetermined timing such asthe standard video synchronization.

In step S5308, the tape recorder 5120 is selected as a recording medium.

In step S5310, the microcomputer 5109 a causes the switch 5133 to selectthe output of the LPF 5132. Thereby, an image signal that contains theinclination guide display that is superimposed on the standard videosignal and whose frequency band has been limited is transmitted to anddisplayed on the viewfinder 5106.

In step S5312, the process determines whether or not the trigger switch(not shown) has been pressed. If the trigger switch has been pressed,the process proceeds to step S5314. If the trigger switch has not beenpressed, the process proceeds to step S5320 and then ends.

If the trigger switch has been pressed, then the process determines instep S5314 whether or not the moving image pickup is being performed. Ifthe moving image pickup is being performed, the process proceeds to stepS5315. If the moving image recording is not being performed, the processproceeds to step S5316.

If the moving image recording is being performed, then in step S5315,the moving image recording is stopped in response to the operation ofthe trigger switch.

If the moving image recording is not being performed, then in stepS5316, the moving image recording is started in response to theoperation of the trigger switch.

According to the above processes, the inclination guide display isdisplayed on the viewfinder 5106 without changing its frequencyresponsiveness when the still image pickup mode is selected, and theinclination guide display is displayed on the viewfinder 5106 with thelimitation of its frequency responsiveness when the moving image pickupmode is selected.

The relationship between the inclination of the video camera 5400 andthe output of the inclination sensor 5107 (acceleration sensor) isequivalent to that described above in Embodiment 18 with reference toFIGS. 52A to 52C. The display on the viewfinder is the same as that inthe other embodiments except for its responsiveness.

As described above, the video camera 400 of Embodiment 21 of the presentinvention provides the inclination guide display with higherresponsiveness in the still image pickup mode than in the moving imagepickup mode. Since the responsiveness of the inclination guide displayis lower in the moving image pickup mode than in the still image pickupmode, a variation in the inclination of the inclination guide displaycan be prevented from being shown more clearly than required.

Embodiment 22

FIG. 62 is a block diagram showing the circuit configuration of a videocamera that is Embodiment 22 of the present invention. In FIG. 62,reference numeral 6101 denotes a first fixed lens unit, and referencenumeral 6102 denotes a magnification varying lens unit. Referencenumeral 6103 denotes an aperture stop, and reference numeral 6104denotes a second fixed lens unit. Reference numeral 6105 denotes a lensunit (hereinafter referred to as a focus-compensating lens) having afocusing function and a so-called compensating function for correctingmovement of a focal plane resulting from magnification varying.Reference numeral 6106 denotes an image pickup element (hereinafterreferred to as a CCD). Reference numerals 6110 and 6111 denote a zoomdriving source and a focusing driving source, respectively. Referencenumeral 6107 denotes an AGC (Auto Gain Control circuit) that amplifiesan output from the CCD 6106.

Reference numeral 6108 denotes a camera signal processing circuit thatconverts the output signal from the AGC 6107 into a signal suitable fora recording device 6118 and a display device 6117 having a displayfunction. Moving images and still images are recorded in the recordingdevice 6118. A magnetic tape or a semiconductor memory is used as arecording medium. The display device 6117 is a viewfinder or an externalliquid crystal panel. Reference numeral 6112 denotes an inclinationsensor that detects the inclination of the video camera; an accelerationsensor is used for the inclination sensor in the present embodiment.Reference numeral 6113 denotes an amplifier that amplifies an outputfrom the inclination sensor 6112. Reference numeral 6114 denotes amicrocomputer that controls the system of the video camera.

Reference numeral 6115 denotes a camera controlling part provided in themicrocomputer 6114, which controls the zoom driving source 6110 andfocusing driving source 6111 for variation of the angle of view andfocusing. The camera controlling part 6115 further controls the drive ofthe CCD 6106, AGC 6107, and camera signal processing circuit 6108.Reference numeral 6116 denotes a display controlling part provided inthe microcomputer 6114 to load an output from the amplifier 6113 togenerate a guide display signal corresponding to the inclination, fromdetected inclination information. The display controlling part 6116determines whether or not to provide an inclination guide display on thebasis of the states of a mode switch 6119 and a guide display ON/OFFswitch 6121, which will be described later. To provide the inclinationguide display, the display controlling part 6116 outputs the inclinationguide display signal to the display processing circuit 6109. Thus, thedisplay processing circuit 6109 synthesizes a video signal with theinclination guide display signal to superimposedly show the inclinationguide display on a picked-up image on the screen of the display device6117.

Reference numeral 6119 denotes the mode switch that switches the imagepickup mode between a moving image pickup mode and a still image pickupmode. Reference numeral 6120 denotes a shutter button that is a two-stepswitch indicating a still image pickup operation on the basis of itspressed state. Reference numeral 6121 denotes the guide display ON/OFFswitch that enables the user to optionally turn on or off theinclination guide display. The guide display ON/OFF switch 6121 may bean independent operating member or an item on a menu which can beswitchably operated.

FIGS. 63A to 63D are diagrams showing the relationship between theinclination of the video camera and the output of the inclination sensor6112. In FIGS. 63A to 63C, reference numerals 6100, 6117, and 6112denote the video camera, the display device, and the inclination sensor(acceleration sensor) respectively.

Appropriately setting of the gain of the amplifier 6113 makes itpossible to set the sensor output from the inclination sensor 6112 tohave the voltage range described below.

FIG. 63B shows that the video camera 6100 is at a regular position. Thesensor output is equal to about half of a power supply voltage Vcc asshown at (b′) in FIG. 63D. In contrast, inclining the video camera 6100counterclockwise by 90° as shown in FIG. 63A provides a sensor outputequal to the power supply voltage Vcc as shown at (a′) in FIG. 63D.Conversely, inclining the video camera 6100 clockwise by 90° as shown inFIG. 63C provides a sensor output at a GND level as shown at (c′) inFIG. 63D.

For the inclinations between those shown in FIG. 63A and FIG. 63B andbetween those shown in FIG. 63B and FIG. 63C, the sensor output changeslinearly with the inclination. On the basis of the voltage correspondingto the inclination, the display controlling part 6116 generates theguide display signal indicating the inclination. The display processingcircuit 6109 synthesizes the video signal with the inclination guidedisplay signal. Consequently, the inclination guide display issuperimposed on a picked-up image on the screen of the display device6117.

FIG. 64 is a flowchart showing the operation of the microcomputer 6114performed by the display controlling part 6116 for the inclination guidedisplay.

First, in step #6301, the process determines whether the image pickupmode is set for the moving image pickup mode or the still image pickupmode on the basis of the setting of the mode switch 6119. In the movingimage pickup mode, the process returns to a main routine withoutoutputting any guide display signal to the display processing circuit6109, that is, without providing any inclination guide display. In thestill image pickup mode, the process proceeds to step #6302.

In the still image pickup mode, the process proceeds to step #6302 todetermine whether or not the guide display ON/OFF switch 6121 is on. Ifthe guide display ON/OFF switch 6121 is off, the process returns to themain routine without outputting any guide display signal to the displayprocessing circuit 6109. On the other hand, if the guide display ON/OFFswitch 6121 is on, the process proceeds to step #6303 to acquire theinclination information output by the inclination sensor 6112. Then, innext step #6304, the process determines whether or not the shutterbutton 6120 is in a half pressed position. If the shutter button 6120 isin a position other than the half pressed position, the process returnsto the main routine without outputting any guide display signal to thedisplay processing circuit 6109, that is, without providing anyinclination guide display. If the shutter button 6120 is in the halfpressed position, the process proceeds to step #6305.

In step #6305, the guide display signal is generated from theinclination information acquired in step #6303; the guide display signalindicates the position of the inclination guide display to be shown onthe screen of the display device 6117. In next step #6306, theinclination guide display signal is output to the display processingcircuit 6109 in order to superimpose the inclination guide displaysignal on the video signal from the camera signal processing circuit6108 to show the inclination guide display on the screen of the displaydevice 6117.

FIG. 65 shows an example in which the process shown in FIG. 64 isexecuted to show, on the screen of the display device 6117, theinclination guide display and a horizontal reference position (describedlater) that are superimposed on a picked-up image. As illustrated in thefigure, the horizontal reference position 6401 and the inclination guidedisplay 6402 on the basis of the inclination guide display signalgenerated at step #6305 in FIG. 64 are shown, which enables a user toquickly recognize the inclination of the video camera from thedifference between the inclination guide display and the horizontalreference position.

The detection of the inclination information in step #6303 in FIG. 64may be performed next to the determination that the shutter button 6120is in the half pressed position in step #6304.

In many applications, in the moving image pickup mode, the user picks upan image of a moving object at least with the video camera held by hisor her hand while panning it for chasing the object. It is thusdifficult for the user to keep the camera horizontal. In fact, theinclination guide display may be useless for the user. Thus, Embodiment22 prevents the process from proceeding to steps #6305 and #6306 in FIG.64 to prohibit the inclination guide display in such a case. This makesit possible to prevent the user from feeling uncomfortable owing totheir inability to hold the video camera horizontal. The prohibitionalso prevents the user from feeling that a constant movement of theinclination guide display shown on the screen of the display device 6117during image pickup is cumbersome. The prohibition also makes itpossible to prevent a smooth inclination guide display from beinghindered, particularly when the capability of the microcomputer 6114 islow, because the detection of the inclination information and theprocess of showing the inclination guide display on the screen of thedisplay device 6117 increase loads on the moving image pickupprocessing.

Even in the still image pickup mode, when the shutter button 6120 is ina position other than the half pressed position (YES in step #6304), theprocess does not proceed to #6305 or #6306 in FIG. 64, prohibiting theinclination guide display. This makes it possible to prevent the userfrom feeling uncomfortable in the still image pickup mode, as is thecase with the moving image pickup mode.

On the other hand, if the shutter button 6120 is in the half pressedposition, the user attempts to hold the camera horizontal so as toestablish his or her intended composition, particularly a composition inwhich the object is not inclined, in order to record that scene. Thus,if the shutter button 6120 is in the half pressed position, theprovision of the inclination guide display is permitted to display theinclination of the video camera on the screen, providing beneficialinformation to the user. This configuration also makes it possible toprevent the recorded image from inclining or rotational corrections onthe inclined image from being required during reproduction. Moreover, ifthe shutter button 6120 is in the half pressed position, AF (autofocus), AE, and the like are locked, thereby minimizing processingloads. A smooth inclination display guide can thus be provided.

The above process provides an image pickup apparatus such as the videocamera that can provide displays meeting sufficient conditions for theuser and which can be comfortably operated.

Embodiment 23

FIG. 66 is a flowchart showing the operation of a microcomputer providedin a video camera that is Embodiment 23 of the present invention for theinclination guide display. Each step in Embodiment 23 performing thesame operation as that in Embodiment 22 shown in FIG. 64 is denoted byreference numeral having the same last two digits as those in FIG. 64.The circuit configuration of the video camera is similar to that in theEmbodiment 22.

First, in step #6401, the process determines whether the image pickupmode is set to the moving image pickup mode or the still image pickupmode on the basis of the setting of the mode switch 6119. In the movingimage pickup mode, the process returns to the main routine withoutgenerating any inclination guide display signal, that is, withoutproviding any inclination guide display. In the still image pickup mode,the process proceeds to step #6402.

In the still image pickup mode, the process proceeds to step #6402 todetermine whether or not the guide display ON/OFF switch 6121 is on. Ifthe guide display ON/OFF switch 6121 is off, the process returns to themain routine without generating any inclination guide display signal. Onthe other hand, if the guide display ON/OFF switch 6121 is on, theprocess proceeds to step #6403 to determine whether or not the shutterbutton 6120 is in the half pressed position. If the shutter button 6120is in the half pressed position, the process proceeds to step #6405.

In step #6405, the inclination information output from the inclinationsensor 6112 is acquired. Then, in next step #6406, the processdetermines whether or not an in-focus position is being searched for bydriving of the focus-compensating lens 6105 in response to a user's halfpress operation of the shutter button 6120. If the focus searching hasbeen finished and thus a focus search end flag is on, the processproceeds to step #6411.

If the focus search end flag is off, the process proceeds to step #6407to perform the focus searching. The process then determines in next step#6408 whether or not the focus searching has been finished. The focussearching is finished when the in-focus position has successfully beendetected or has not been detected for a predetermined time. Upondetermining that focus searching has not been finished, the processreturns to the main routine to continue the focus searching.

Upon determining in step #6408 that the focus searching has beenfinished, the process proceeds to step #6409 to drive thefocus-compensating lens 6105 to a predetermined position. Then, in nextstep #6410, the focus search end flag is turned on. In subsequent step6411, on the basis of the inclination information acquired in step#6405, the inclination guide display signal is generated which indicatesthe position of the inclination guide display to be displayed on thescreen of the display device 6117. In next step #6412, the inclinationguide display signal is output to the display processing circuit 6109 inorder to show the inclination guide display superimposed on the videosignal from the camera signal processing circuit 6108 on the screen ofthe display device 6117.

Upon determining in step #6403 that the shutter button 6120 is not inthe half pressed position, the process proceeds to step #6404 todetermine that the image pickup target object will change because theuser has released the shutter button 6120 or fully pressed it to recordthe picked-up image, and thus the process turns off the focus search endflag.

In many applications, in the moving image pickup mode, the user picks upan image of a moving object at least with the video camera held by hisor her hand while panning it for chasing the object. It is thusdifficult for the user to keep the camera horizontal. In fact, theinclination guide display may be useless for the user. Thus, likeEmbodiment 22, Embodiment 23 prevents the process from proceeding tosteps #6411 and #6412 in FIG. 65 to prohibit the inclination guidedisplay. This makes it possible to prevent the user from feelinguncomfortable owing to their inability to hold the video camerahorizontal. The prohibition also prevents the user from feeling that aconstant movement of the inclination guide display shown on the screenof the display device 6117 during image pickup is cumbersome. Theprohibition also makes it possible to prevent a smooth inclination guidedisplay from being hindered, particularly when the capability of themicrocomputer 6114 is low, because the detection of the inclinationinformation and the process of showing the inclination guide display onthe screen of the display device 6117 increase loads on the moving imagepickup processing.

Further, in the still image pickup mode, even when the shutter button6120 is in the half pressed position, the process cannot determinewhether or not an in-focus state on the user-intended object is achievedduring the focus searching (NO in step #6408). Further, since thefocus-compensating lens 6105 is being driven to search for the in-focusposition during the focus searching, processing loads are imposed as inthe case of the moving image pickup mode. Thus, in particular, if thecapability of the microcomputer 6114 is low, providing a smoothinclination guide display is difficult. To avoid this, Embodiment 23prohibits the inclination guide display during the focus searching withthe shutter button 6120 in the half pressed position.

On the other hand, description will be given of the case where the focussearching has been finished with the shutter button 6120 in the halfpressed position and thereby an in-focus state is achieved (step#6406→step #6411 or step #6408→step #6409→step #6410→step #6411). Inthis case, the user attempts to hold the camera horizontal so as toestablish his or her intended composition, particularly the state inwhich the object is not inclined. Thus, Embodiment 23 provides theinclination guide display to show the inclination of the camera (step#6412). This enables the user to obtain beneficial information foreasily holding the camera horizontal. Moreover, when the focus searchingis finished, AF (auto focus), AE, and the like are locked, therebyminimizing processing loads. A smooth inclination display guide can thusbe provided. This makes it possible to provide a display meetingsufficient conditions for the user, thus enabling the user tocomfortably operate the camera.

The detection of the inclination information in step #6405 may beperformed in step next to step #6408 where the process determines thatthe focus searching has been finished, or in step next to step #6410where the process determines that the focus search end flag is on.Moreover, although not shown, the process determines in step #6408 thatthe focus searching has been finished. However, if the in-focus positionhas not been detected, the inclination guide display may be prohibited.

In Embodiments 22 and 23, the inclination sensor 6112 and the amplifier6113 may be energized only when the inclination information is detectedand the inclination guide display is provided on the basis of theinformation. The operation of the inclination sensor 6112 is preventedunder conditions that the inclination guide display is prohibited,enabling a reduction in power consumption and processing loads.

The effects of the above embodiments are listed below.

The inclination of the video camera, which is an example of the imagepickup apparatus, is detected and the inclination guide displaycorresponding to the detected inclination is prohibited at least duringthe moving image pickup. This makes it possible to prevent the user fromfeeling that, in a situation where the user cannot hold the camerahorizontal easily, the inclination guide display always shown iscumbersome. It is further possible to prevent a smooth inclination guidedisplay from becoming difficult, particularly when the capability of themicrocomputer 6114 is low, because the detection of the inclinationinformation and the process of showing the inclination guide displayoverload the microcomputer 6114 during the moving image pickup. Similareffects are produced even if the shutter button is in a position otherthan the half pressed position during the still image pickup.

In the still image pickup, when the shutter button 6120 is in the halfpressed position, the provision of the inclination guide display ispermitted. Thus, the inclination guide display enables the user to holdthe camera horizontal, which prevents the user from recording an imagehaving the user's unintended composition in which, for example, theobject is inclined. That is, in this case, the inclination guide displayis beneficial to the user who desires to record that scene. Further,depending on situations, in order to display an unintentionally inclinedimage horizontally in its reproduction, it is possible to reduce theuser's burden of manually performing a rotational correcting operationon the reproduced image. As for the processing loads, when the shutterbutton 6120 is in the half pressed position, AF (auto focus) AE, and thelike are locked, so that a smooth inclination guide display can beperformed without sharply increasing the processing loads.

As described above, Embodiments 22 and 23 permit the inclination guidedisplay to be provided if the display meets sufficient conditions forthe user. This enables the user to comfortably operate the camera.

Embodiment 24

FIG. 67 is a schematic block diagram showing the system configuration ofan image pickup apparatus 7001 that is Embodiment 24 of the presentinvention. The image pickup apparatus 7001 picks up an image of anobject with an image pickup element, the image being formed by lightfrom the object through an image pickup optical system. The image pickupapparatus of the present embodiment is implemented as a cam coder.

In FIG. 67, reference numeral 7101 denotes a first fixed lens unit, andreference numeral 7102 denotes a zoom lens (magnification varying lensunit) for varying the magnification. Reference numeral 7103 denotes anaperture stop, and reference numeral 7104 denotes a second fixed lensunit. Reference numeral 7105 denotes a focus lens (lens unit) having afocusing function and a so-called compensating function of correctingmovement of a focal plane resulting from the magnification varying.Reference numeral 7106 denotes an image pickup element such as a CCDthat photoelectrically converts an optical object image and outputs theresulting video signal.

Reference numeral 7107 denotes an analog signal processing circuit. Theanalog signal processing circuit 7107 executes predetermined processingon a signal provided by the image pickup element 7106 to generate ananalog image pickup signal. The analog signal processing circuit 7107 isconstituted by, for example, a CDS (Co-related Double Sampling) circuitand an AGC (Automatic Gain Control) circuit.

Reference numeral 7108 denotes a camera signal processing circuitincluding an A/D converter. The camera signal processing circuit 7108converts the analog image pickup signal generated by the analog signalprocessing circuit 7107 into a digital signal. The camera signalprocessing circuit 7108 further executes predetermined signal processingsuch as gamma correction and white balancing on the digital signal togenerate a final output video signal.

Reference numeral 7109 denotes a recording device in which moving imagesand still images are recorded. A magnetic tape or a semiconductor memoryis used as a recording medium.

The analog image pickup signal amplified by the analog signal processingcircuit 7107 (the AGC) is transmitted to an AF gate 7112 and an aperturestop controlling circuit 7121. The AF gate 7112 sets a region in theentire image pickup area from which the optimum signal is extracted forfocusing. The size of the AF gate 7112 (that is, the region from whichthe signal for focusing is extracted) is variable. Alternatively, aplurality of AF gates 7112 may be provided.

Reference numeral 7113 denotes an AF signal processing circuit. The AFsignal processing circuit 7113 extracts a high frequency component, alow frequency component, and a luminance difference component (thedifference between the maximum and minimum values of luminance level ofthe video signal) which are used for focus detection.

Reference numeral 7114 denotes a main controlling part. In the presentembodiment, the main controlling part 7114 is constituted by a cameracontrolling part 7115 and a display controlling part 7116.

The camera controlling part 7115 controls the drive of the camera signalprocessing circuit 7108 and an output signal therefrom and controls thefocus lens 7105 on the basis of an output signal from the AF signalprocessing circuit 7113. The camera controlling part 7115 also readsinformation on the operation of the zoom switch 7128 to control zooming(a voltage corresponding to the rotation angle or slide amount of thezoom switch 7128 is output and variable-speed zooming is performeddepending on the output voltage). The camera controlling part 7115 movesthe focusing lens 7105 so as to maximize the level of the output signalfrom the AF signal processing circuit 7113. This enables automaticfocusing to be accomplished.

An aperture stop controlling circuit 7123 drives the aperture stop 7103so as to maintain an appropriate exposure. In other words, the aperturestop controlling circuit 7123 detects the level of the output signalfrom the analog signal processing circuit 7107. If the output signal isnot at a given level (appropriate exposure), the aperture stopcontrolling circuit 7123 generates an aperture control signal forsetting the output signal to the given level. The aperture controlsignal is output to an IG driver 7124 to drive the aperture stop 7103via an IG motor 7125 so as to provide the appropriate exposure.

Reference numerals 7117 and 7118 denote drivers that output drivingenergy to lens driving motors in accordance with instructions on drivingof the zoom lens 7102 and focus lens 7105, the instructions being outputfrom the camera controlling part 7115 and the drivers being able tochange an electric current waveform. Reference numerals 7119 and 7120denote the lens driving motors that drive the zoom lens 7102 and focuslens 7105. The positions of the zoom lens 7102 and focus lens 7105 aredetected by lens position detectors 7121 and 7122.

Each of the lens position detectors 7121 and 7122 is constituted by aphoto sensor (not shown) and a light-shielding plate (not shown). Thephoto sensor is constituted by a light-emitting part and alight-receiving part. The light-shielding plate is fixed to each of thezoom lens 7102 and focus lens 7105. Accordingly, the movements of thezoom lens 7102 and focus lens 7105 parallel to their optical axis movethe light-shielding plates integrally with the zoom lens 7102 and focuslens 7105. Thus, if the light-shielding plate blocks the optical pathbetween the light-emitting part and the light-receiving part of thephoto sensor, an output signal from the light-receiving part is at a lowlevel. If the light-shielding plate does not block the optical pathbetween the light-emitting part and the light-receiving part of thephoto sensor, the output signal from the light-receiving part is at ahigh level. Thus, when the position where the output signal from thelight-receiving part changes is defined as a reference position, it ispossible to detect whether or not the zoom lens 7102 and the focus lens7105 are present at the reference position. The camera controlling part7115 can recognize the position of each lens on the basis of thereference position, the moving speed and moving direction of the lens.

The zoom switch 7128 is connected to the camera controlling part 7115.The zoom switch 7128 is operated to move the zoom lens 7102 in awide-angle direction or in a telephoto direction. The zoom switch 7128has a circuit configuration such that its voltage changes depending on apressing force acting thereon. The camera controlling part 7115 detectsa change in voltage when the zoom switch 7128 is pressed. The cameracontrolling part 7115 determines the zoom speed at which the zoom lens7102 is driven, on the basis of the detected voltage.

Reference numeral 7126 denotes an inclination sensor. The inclinationsensor 7126 detects the inclination of the image pickup apparatus 7001.In the present embodiment, an acceleration sensor is used for theinclination sensor 7126.

Reference numeral 7127 denotes an amplifier circuit. The amplifiercircuit 7127 amplifies an output from the inclination sensor(acceleration sensor) 7126.

In the main controlling part 7114, the display controlling part 7116loads an output from the amplifier circuit 7127 to determine whether ornot to provide a guide display corresponding to the inclination on thebasis of inclination information detected by the inclination sensor7126. The display controlling part 7116 provides its output to a guidedisplay setting part 7129.

The guide display setting part 7129 outputs the guide display (displayshowing the inclination of the image pickup apparatus 7001)corresponding to the inclination of the image pickup apparatus 7001. Thedisplay processing circuit 7110 superimposes the guide display on theoutput video signal. The display device 7111 such as a viewfinder or aliquid crystal panel shows the output video signal with the guidedisplay superimposed thereon.

A control operation (display method) performed by the displaycontrolling part 7116 will be described. FIG. 68 is a flowchartillustrating the control operation performed by the display controllingpart 7116.

As shown in FIG. 68, first, the inclination information on the imagepickup apparatus 7001 is detected on the basis of the output from theinclination sensor 7126 (step S7102). Then, the process determineswhether or not the current zoom position is on the telephoto side (orthe wide-angle side) (step S7104).

In step S7104, if the current zoom position is on the telephoto side,the process determines whether or not the current inclination of theimage pickup apparatus 7001 is equal to or larger than a predeterminedvalue α (step S7106). If the current inclination of the image pickupapparatus 7001 is equal to or larger than the predetermined value α, theguide display is turned on (step S7108). If the current inclination ofthe image pickup apparatus 7001 is smaller than the predetermined valueα, the guide display is turned off (step S7112).

On the other hand, in step S7104, if the current zoom position is on thewide-angle side, the process determines whether or not the currentinclination of the image pickup apparatus 7001 is equal to or largerthan a predetermined value β (step S7110). If the current inclination ofthe image pickup apparatus 7001 is equal to or larger than thepredetermined value β, the guide display is turned on (step S7108). Ifthe current inclination of the image pickup apparatus 7001 is smallerthan the predetermined value β, the guide display is turned off (stepS7112).

The relationship between the predetermined values α and β meets thefollowing expression:

>β.

As is apparent from the above equation, the inclination at which theguide display is turned on is set smaller on the wide-angle side than onthe telephoto side. As a result, on the wide-angle side, on which theinclination of the image pickup apparatus 7001 is more noticeable, theguide display is provided for a smaller inclination than on thetelephoto side.

FIG. 69 is a graph showing the relationship between the inclination ofthe image pickup apparatus 7001 and the output from the inclinationsensor (acceleration sensor) 7126. In FIG. 69, the horizontal axisindicates the inclination of the image pickup apparatus 7001. Thevertical axis indicates the output from the inclination sensor 7126.Appropriately setting of the gain of the amplifier circuit 7127 makes itpossible to provide the output from the inclination sensor 7126 to havethe voltage ranges (A) to (C) shown in FIG. 69.

First, the voltage range (B) indicates that the output from theinclination sensor 126 is equal to half of a power supply voltage Vcc,and that the image pickup apparatus 7001 is at a regular position, thatis, a picked-up image is kept horizontal. In contrast, the voltage range(A) indicates that the output from the inclination sensor 7126 is at aGND level and that the image pickup apparatus 7001 is inclinedcounterclockwise by 90°. The voltage range (C) indicates that the outputfrom the inclination sensor 7126 is equal to the power supply voltageand that the image pickup apparatus 7001 is inclined clockwise by 90°.

For the inclinations between those in the voltage ranges (A) and (B) andbetween those in the voltage ranges (B) and (C), the output from theinclination sensor 7126 changes linearly with the inclination of theimage pickup apparatus 7001. Appropriately, by setting a threshold of apredetermined voltage with respect to the output from the inclinationsensor 7126 obtained at the regular position, indicated by the voltagerange (B), it is possible to determine whether or not the inclination ofthe image pickup apparatus 7001 is equal to or larger than apredetermined angle (predetermined value α or β). In other words, theswitching of the threshold (voltage value) for the output from theinclination sensor 7126 between the wide-angle side and the telephotoside enables the angle at which the guide display is turned on to beseparately set for the wide-angle side and for the telephoto side.Reversing the direction of the inclination sensor 7126 reverses thevariation in the output from the inclination sensor 7126 provided whenthe image pickup apparatus 7001 is inclined, with respect to that shownin the graph in FIG. 69.

FIGS. 70A and 70B schematically show the range in which the guidedisplay is provided on the display device 7111 such as a viewfinder or aliquid crystal panel. As described above, the threshold (voltage value)for the output from the inclination sensor 7126, providing a guidedisplay, is switched between the wide-angle side and the telephoto side.Thus, as shown in FIGS. 70A and 70B, the area in which the guide displayis turned off can be made narrower for the wide-angle side than for thetelephoto side. Here, FIG. 70A shows the range in which the guidedisplay is provided for the wide-angle side. FIG. 70B shows the range inwhich the guide display is provided for the telephoto side.

In step S7104 shown in FIG. 68 to determine whether or not the zoomposition is on the telephoto side, a determination may be made whetheror not the zoom position is closer to the telephoto end (or thewide-angle end) than a predetermined position. Further, arbitrarysetting of the predetermined position enables changing the determinationof whether or not the zoom position is on the telephoto side (or on thewide-angle side) on the basis of the arbitrary predetermined position.Accordingly, setting the predetermined position at the vicinity of thetelephoto end enables the inclination of the image pickup apparatus 7001to be displayed in almost entire zoom area except for the vicinity ofthe telephoto end. This enables the user to quickly determine howinclined the camera is. On the other hand, setting the predeterminedposition at the vicinity of the wide-angle end enables the guide displayto be provided only in the vicinity of the wide-angle end. Thereby, inthe middle zoom area and on the telephoto side, the inclination guidedisplay is not provided unless the image pickup apparatus 7001 issignificantly inclined. Thus, the user can perform image pickup whilepaying little attention to the horizontal state.

Thus, when showing the guide display corresponding to the inclination ofthe image pickup apparatus 7001, the present embodiment changes theinclination at which the guide display is provided between thewide-angle side and the telephoto side. In particular, for wide-angleside image pickup, in which the inclination of the image pickupapparatus 7001 is more noticeable, reducing the inclination at which theguide display is provided enables the user to be quickly noticed of theinclination of the image pickup apparatus 7001. This also enables anincrease in the accuracy with which the image pickup apparatus 7001 iskept horizontal.

Moreover, changing the setting of the inclination of the image pickupapparatus 7001 at which the guide display is provided also makes itpossible that the guide display is always provided on the wide-angleside and always avoided on the telephoto side. In this case, setting maybe made such that on the wide-angle side, the guide display is turned onwhen the inclination of the image pickup apparatus 7001 is 0° or larger,whereas on the telephoto side, the guide display is turned off when theinclination of the image pickup apparatus 7001 is smaller than ±90°.

In the present embodiment, the guide display is switched according tothe zoom position determination in two divided zoom areas, that is, thedetermination of whether or not the zoom position is on the telephotoside (or the wide-angle side). However, the present invention is notlimited thereto. For example, by dividing the entire zoom area intothree areas and defining the inclinations of the image pickup apparatus7001 at which the guide display is provided in the respective zoomareas, as α, β, and γ, it is possible to switch the guide displaybetween the three zoom areas, a wide-angle area, a middle area, and atelephoto area. Moreover, by increasing the number of areas into whichthe entire zoom area is divided and setting the inclinations of theimage pickup apparatus 7001 at which the guide display is provided, inassociation with the number of the resulting areas, it is possible tocontrol the guide display for any number of zoom areas obtained by thedivision.

Next, with reference to FIG. 71, description will be given of anothercontrol operation performed by the display controlling part 7116 in themain controlling part 7114. FIG. 71 is a flowchart illustrating thecontrol operation performed by the display controlling part 7116.

As shown in FIG. 71, first, the inclination information on the imagepickup apparatus 7001 is detected on the basis of the output from theinclination sensor 7126 (step S7202). Then, on the basis of theinclination information detected in step S7202, the process determineswhether or not the current inclination of the image pickup apparatus7001 (that is, the detected inclination of the image pickup apparatus7001) is equal to or larger than the predetermined value α (step S7204).

If the current inclination of the image pickup apparatus 7001 is smallerthan the predetermined value α, the guide display is turned off (stepS7206) and the process proceeds to step S7216, described below. On theother hand, if the current inclination of the image pickup apparatus7001 is equal to or larger than the predetermined value α, the guidedisplay is turned on (step S7208). The process then determines whetheror not the current zoom position is on the wide-angle side (step S7210).

In step S7210, if the current zoom position is on the telephoto side,the display sensitivity of the guide display is set to a normal level(step S7212). If the current zoom position is on the wide-angle side,the display sensitivity of the guide display is increased (step S7214).This is an operation for exaggeratedly displaying the inclination of theimage pickup apparatus 7001 at which the guide display is provided; aninclination larger than the actual one is displayed. Display informationis then provided to the guide display setting part 7129 (step S7216) toshow the guide display on the display device 7111.

In the present embodiment, if the zoom position is on the wide-angleside, the guide display is exaggerated to make the inclination of theimage pickup apparatus 7001 clearer to enable the user to easilyrecognize it. Further, if the zoom position is on the wide-angle side,the display sensitivity of the guide display is increased to enable theuser to easily recognize a variation in the inclination of the imagepickup apparatus 7001 resulting from its slight movement (shake). Theuser can thus easily set the image pickup apparatus 7001 horizontal.Setting the image pickup apparatus 7001 horizontal makes its inclinationsmaller than the predetermined value α in step S7204, shown in FIG. 71.This turns off the guide display.

Thus, for a wide-angle zoom position, the present embodiment changes(increases) the display sensitivity of the guide display compared to atelephoto zoom position. This enables the user to be noticed of theinclination of the image pickup apparatus 7001 in aneasier-to-understand manner. Moreover, the present embodiment enablesthe user to clearly recognize the movement amount of the image pickupapparatus 7001 in response to its slight inclination. This enables theimage pickup apparatus 7001 to be easily kept horizontal.

With reference to FIG. 72, description will be given below of thecontrol operation performed by the display controlling part 7116 andwhich is a combination of the control operations shown in FIG. 68 andFIG. 71. In other words, the present embodiment switches the inclinationat which the guide display is provided between the wide-angle side andthe telephoto side so that the display sensitivity of the guide displayis increased on the wide-angle side to exaggeratedly display theinclination of the image pickup apparatus 7001. FIG. 72 is a flowchartillustrating another control operation performed by the displaycontrolling part 7116.

As shown in FIG. 72, first, the inclination information on the imagepickup apparatus 7001 is detected on the basis of the output from theinclination sensor 7126 (step S7302). Then, the process determineswhether or not the current zoom position is on the wide-angle side (orthe telephoto side) (step S7304).

In step S7304, if the current zoom position is on the wide-angle side,the process determines, on the basis of the inclination informationdetected in step S7302, whether or not the current inclination of theimage pickup apparatus 7001 (that is, the detected inclination of theimage pickup apparatus 7001) is equal to or larger than thepredetermined value β (step S7306). If the inclination of the imagepickup apparatus 7001 is equal to or larger than the predetermined valueβ, the guide display is turned on and its display sensitivity isincreased (step S7308). Then, display information is provided to theguide display setting part 7129 (step S7310) to show the guide displayon the display device 7111.

On the other hand, in step S7304, if the current zoom position is on thetelephoto side, the process determines, on the basis of the inclinationinformation detected in step S7302, whether or not the currentinclination of the image pickup apparatus 7001 is equal to or largerthan the predetermined value α (step S7312). If the inclination of theimage pickup apparatus 7001 is equal to or larger than the predeterminedvalue α, the guide display is turned on and its display sensitivity isset to the normal level (step S7314). Then, as is the case with awide-angle zoom position, display information is provided to the guidedisplay setting part 7129 (step S7310) to show the guide display on thedisplay device 7111.

If in step S7306, the inclination of the image pickup apparatus 7001 issmaller than the predetermined value β or if in step S7312, theinclination of the image pickup apparatus 7001 is smaller than thepredetermined value α, the image pickup apparatus 7001 is kept almosthorizontal. Accordingly, the guide display is turned off (step S7316).Then, the guide display setting part 7129 is instructed to turn off theguide display (step S7310). In accordance with the instruction, theguide display on the display device 7111 is turned off.

Here, the relationship between the predetermined values α and β meets:

>(display sensitivity magnification×β).

This makes the inclination of the image pickup apparatus 7001 at whichthe guide display is turned on always smaller on the wide-angle sidethan on the telephoto side. The exaggeration level of the guide displayon the wide-angle side increases as the inclination of the image pickupapparatus 7001 increases.

The present embodiment provides the guide display at a smallerinclination on the wide-angle side, at which the inclination of theimage pickup apparatus 7001 is more noticeable. This enables the user tobe quickly noticed of the inclination of the image pickup apparatus7001. Further, if the image pickup apparatus 7001 is steeply inclined,the inclination is exaggeratedly displayed compared to the actual one.This makes the inclination of the image pickup apparatus 7001 clearer.The present embodiment also enables the user to easily recognize avariation in the inclination of the image pickup apparatus 7001resulting from its slight movement. The user can thus easily set theimage pickup apparatus 7001 horizontal. The accuracy of the horizontalstate can also be increased.

As described with reference to FIG. 68, changing the setting of theinclination of the image pickup apparatus 7001 at which the guidedisplay is provided also makes it possible that the guide display isalways provided on the wide-angle side and always avoided on thetelephoto side. In this case, setting may be made such that on thewide-angle side, the guide display is turned on when the inclination ofthe image pickup apparatus 7001 is 0° or larger, whereas on thetelephoto side, the guide display is turned off when the inclination ofthe image pickup apparatus 7001 is smaller than ±90°.

Description will be given of another configuration of a detecting meansfor detecting the inclination of the image pickup apparatus 7001. FIG.73 is a schematic block diagram showing an example of the configurationof the detecting means.

Reference numeral 7701 denotes a variable gain amplifier that can changethe gain for the output from the inclination sensor 7126. The variablegain amplifier 7701 can change the gain via a gain controlling part 7702contained in the main controlling part 7714, on the basis of the zoomposition determined by the camera controlling part 7115.

FIG. 74 is a schematic block diagram showing the configuration of thevariable gain amplifier 7701. The variable gain amplifier 7701 includesa gain switch 7703, an amplifier 7704, and resistors 7705, as shown inFIG. 74. A gain switch signal from the gain controlling part 7114 turnson the gain switch 7703 to connect input resistors in parallel with eachother with respect to the amplifier 7704, increasing the gain of theamplifier 7701. This increases the sensor sensitivity. This gain changeis made in order to exaggerate the inclination of the image pickupapparatus 7001 shown by the guide display compared to the actual one ifthe current zoom position is on the wide-angle side.

With reference to FIG. 75, description will be given of the controloperation performed by the display controlling part 7116 in connectionwith the configuration of the detection means shown in FIG. 73. FIG. 75is a flowchart illustrating another control operation performed by thedisplay controlling part 7116. With reference to FIG. 75, theinclination information of the image pickup apparatus 7001, which is theoutput from the variable gain amplifier 7701, is detected (step S7402).Then, the process determines whether or not the current zoom position ison the wide-angle side (step S7404).

In step S7404, if the current zoom position is on the wide-angle side,the process determines whether or not the sensor sensitivity has beenincreased (step S7406). In other words, the process determines whetheror not the gain of the variable gain amplifier 7701 is set higher. Ifthe sensor sensitivity has not been increased, the sensor sensitivity isincreased (step S7408). On the other hand, if the sensor sensitivity hasbeen increased, the process determines, on the basis of the inclinationinformation detected in step S7402, whether or not the currentinclination of the image pickup apparatus 7001 (that is, the detectedinclination of the image pickup apparatus 7001) is equal to or largerthan the predetermined value α (step S7410). If the current inclinationof the image pickup apparatus 7001 is equal to or larger than thepredetermined value α, the guide display is turned on (step S7412).Then, display information is provided to the guide display setting part7129 (step S7414) to show the guide display on the display device 7111.

On the other hand, if the current zoom position is on the telephotoside, the process determines whether or not the sensor sensitivity isset at the normal level (step S7416). If the sensor sensitivity is notset at the normal level, it is changed to the normal level (step S7418).This is an operation for turning off the gain switch 7703 of thevariable gain amplifier 7701. If the sensor sensitivity is set at thenormal level, the process proceeds to step S7410.

Regardless of whether the current zoom position is on the wide-angleside or on the telephoto side, the guide display is turned off if theinclination of the image pickup apparatus 7001 is smaller than thepredetermined value α in step S7410 (step S7420). Then, the guidedisplay setting part 7129 is instructed to turn off the guide display(step S7414). In accordance with the instruction, the guide display onthe display device 7111 is turned off.

Thus, setting the gain of the variable gain amplifier 7701 higher whenthe current zoom position is on the wide-angle side than when thecurrent zoom position is on the telephoto side can obtain effectssimilar to those of the display control described with reference to FIG.71. That is, the user can be made to clearly recognize the inclinationof the image pickup apparatus 7001 on the wide-angle side, on which theinclination of the image pickup apparatus 7001 is more noticeable. Thepresent embodiment also enables the user to easily recognize a variationin the inclination of the image pickup apparatus 7001 resulting from itsslight movement. The user can thus easily set the image pickup apparatus7001 horizontal. The accuracy of the horizontal state can also beincreased.

As described with reference to FIG. 68, the display control shown inFIGS. 71, 72, and 75 also enables switching between the determination ofwhether or not the zoom position is on the wide-angle side and thedetermination of whether or not the zoom position is on the telephotoside, by arbitrarily setting the predetermined position on the basis ofwhich the zoom position is determined. Further, by dividing the entirezoom area into three areas and defining the inclinations of the imagepickup apparatus 7001 at which the guide display is provided in therespective areas as α, β, and γ, it is possible to switch the guidedisplay between the three zoom areas, the wide-angle area, the middlearea, and the telephoto area. Moreover, by increasing the number ofareas into which the entire zoom area is divided and setting theinclinations of the image pickup apparatus 7001 at which the guidedisplay is provided, in association with the number of the resultingareas, it is possible to control the guide display for any number ofzoom areas obtained by the division.

The image pickup apparatus 7001 changes the inclination at which theguide display is displayed or not displayed depending on the zoomposition. Thus, on the wide-angle side, on which the inclination of theimage pickup apparatus 7001 is noticeable, the user can be noticed ofeven a slight inclination (that is, the user can be urged to correct theinclination). The image pickup apparatus 7001 can thus provide an imagehaving no noticeable inclination, that is, a high quality image.Further, on the telephoto side, on which the inclination of the imagepickup apparatus 7001 is unnoticeable, the display of information (guidedisplay) on the horizontal state of the image pickup apparatus 7001 canbe avoided unless the image pickup apparatus 7001 is significantlyinclined. This makes it possible to prevent disorder on the displayedimage. Thus, the image pickup apparatus 7001 can provide high qualityimages and improve convenience for the user.

Embodiment 25

FIG. 76 is a block diagram showing the outlined configuration of a videocamera that is Embodiment 25. Reference numeral 8101 denotes a lens unitused to pick up an image of an object. Reference numeral 8102 denotes aCCD that photoelectrically converts an object image formed by the lensunit 8101 into a signal.

Reference numeral 8103 denotes an analog signal processing circuit. Theanalog signal processing circuit 8103 executes predetermined processingon the signal from the CCD 8102 to generate an analog image pickupsignal. The analog signal processing circuit 8103 is constituted by, forexample, a CDS (Co-related Double Sampling) circuit and an AGC(Automatic Gain Control) circuit. Reference numeral 8104 denotes acamera signal processing circuit containing an A/D converter thatconverts the analog image pickup signal into a digital signal. Thecamera signal processing circuit 8104 further executes predeterminedsignal processing such as gamma correction and white balancing on thedigital signal to generate a final output video signal.

Reference numeral 8107 denotes an inclination sensor that detects theinclination of the video camera. In the present embodiment, anacceleration sensor is used for the inclination sensor 8107. Referencenumeral 8108 denotes an amplifier circuit that amplifies an output fromthe inclination sensor 8107.

Reference numeral 8109 denotes a camera system controlling microcomputerincluding a camera controlling part 8111 and a display controlling part8110. The camera controlling part 8111 controls the drive of the CCD8102, analog signal processing circuit 8103, and camera signalprocessing circuit 8104. At the same time, The display controlling part8110 loads an output from the amplifier 8108 to determine whether or notto provide an inclination guide display corresponding to theinclination, on the basis of the detected inclination information. Thedisplay controlling part 8110 then outputs inclination guide displaycontrol information to a guide display setting part 8112.

Reference numeral 8112 denotes the guide display setting part thatoutputs an inclination guide display signal on the basis of theinclination guide display control information from the displaycontrolling part 8110. Reference numeral 8105 denotes a displayprocessing circuit that superimposes, on the basis of the inclinationguide display signal, the inclination guide display on the output videosignal to show them on a display device 8106. Reference numeral 8106denotes the display device such as a liquid crystal panel or aviewfinder.

Reference numeral 8113 denotes an image pickup mode setting switch thatswitches the setting of the image pickup mode. The user can use theimage pickup mode setting switch 8113 to select one of the image pickupmodes included in specifications of the camera such as a scenery imagepickup mode, a portrait image pickup mode, and a sports image pickupmode. For example, for the scenery image pickup mode, exposure controlis set to offer a large depth of field so that sharp images can bepicked up for near views and distant views. For the portrait imagepickup mode, exposure control is set so that the background of a mainobject is out of focus. For the sports image pickup mode, exposurecontrol is set so that the shutter is controlled to weight a high-speedside so as to adequately capture a fast moving object. The setting ofthe image pickup mode may involve modes obtained by combining cameracontrol operations such as exposure control and white balance control.When the image pickup mode is switched, the camera controlling part 8111performs setting for each processing circuit appropriate to the setimage pickup mode.

With reference to FIGS. 77A-1 to 77A-3 and FIG. 77B, description will begiven of the relationship between the inclination of the video cameraand the output from the inclination sensor 8107. In FIGS. 77A-1 to77A-3, reference numerals 8100, 8106, and 8107 denote the video camera,the liquid crystal panel as the display device, and the inclinationsensor (acceleration sensor), respectively. FIG. 77A-2 shows that thevideo camera 8100 is in a normal image pickup state (at a regularposition). FIG. 77A-1 shows that the video camera 8100 is inclinedcounterclockwise by 90°. FIG. 77A-3 shows that the video camera 8100 isinclined clockwise by 90°.

FIG. 77B shows the output characteristics of the inclination sensor 8107observed in the states shown in FIG. 77A-1, FIG. 77A-2, and FIG. 77A-3.In FIG. 77B, the vertical axis indicates the output from the inclinationsensor 8107. The horizontal axis indicates the inclination of theinclination sensor 8107. Reference numeral 8301 denotes the amount ofvariation in the output from the inclination sensor 8107 correspondingto the inclination of the video camera 8100. Appropriately setting ofthe gain of the amplifier circuit 8108, which amplifies the output fromthe inclination sensor 8107, enables the illustrated output range to beobtained.

A point 8201 in FIG. 77B denotes the output from the inclination sensor8107 obtained when the video camera 8100 is at the regular position andwhich is equal to half of a power supply voltage Vcc. In contrast,inclining the video camera 8100 counterclockwise by 90° as shown in FIG.77A-1 provides the output from the inclination sensor 8107 equal to thepower supply voltage Vcc (a point 8202 in FIG. 77B). Conversely,inclining the video camera 8100 clockwise by 90° as shown in FIG. 77A-3provides the output from the inclination sensor 8107 at a GND level (apoint 8203 in FIG. 77B).

For the inclinations between those at points 8201 and 8202 and betweenthose at points 8201 and 8203 in FIG. 77B, the output from theinclination sensor 8107 has a characteristic in which it changeslinearly with the inclination. Accordingly, whether or not apredetermined inclination (angle) has been reached can be determined bysetting a predetermined threshold voltage higher or lower than theoutput voltage corresponding to the regular position shown at the point8201 in FIG. 77B. Switching the threshold voltage for the sensor outputvoltage between the scenery image pickup mode and the image pickup modesother than the scenery image pickup mode (hereinafter referred to as theother image pickup modes) enables the setting of the inclination (angle)at which the guide display is turned on or off (the inclination guidedisplay is provided or not provided) depending on the image pickup mode.Reversing the direction in which the inclination sensor 8107 is mountedreverses the characteristic of the sensor output voltage obtained whenthe video camera 8100 is inclined, with respect to that shown in FIG.77B. However, the similar setting can be made.

FIG. 78 is a flowchart illustrating the processing operation performedby the video camera 8100 of Embodiment 25. In step S301, the camerasystem controlling microcomputer 8109 loads the inclination information.In step S8302, the camera system controlling microcomputer 8109determines the current setting of the image pickup mode. Specifically,the process determines whether or not the scenery image pickup mode isset.

In step S8302, if the scenery image pickup mode is not set, the processproceeds to step S8303, where the camera system controllingmicrocomputer 8109 determines whether or not the current inclination ofthe video camera 8100 is equal to or larger than a set value α. If theinclination is equal to or larger than the value α, the process proceedsto step S8304 to turn on the inclination guide display (the inclinationguide display is provided). If the inclination is smaller than the valueα, the process proceeds to step S8307 to turn off the inclination guidedisplay (the inclination guide display is not provided).

On the other hand, if the scenery image pickup mode is set in stepS8302, the process proceeds to step S8306, where the camera systemcontrolling microcomputer 8109 determines whether or not the currentinclination of the video camera 8100 is equal to or larger than a setvalue β. If the inclination is equal to or larger than the value β, theprocess proceeds to step S8304 to turn on the inclination guide display(the inclination guide display is provided). If the inclination issmaller than the value β, the process proceeds to step S8307 to turn offthe inclination guide display (the inclination guide display is notprovided).

Here, the relationship between α and β is α>β. The inclination of thevideo camera 8100 at which the inclination guide display is turned on oroff (the inclination guide display is provided or not provided) is setsmaller in the scenery image pickup mode than in the other image pickupmodes. That is, in the scenery image pickup mode in which a wide angleof view is often used for image pickup, the inclination of the videocamera being more noticeable at the wide angle of view, the inclinationguide display is provided at a smaller inclination. Consequently, theuser can be warned of even a slight inclination of the video camera8100.

In step S8305, the camera system controlling microcomputer 8109 outputsthe inclination guide display control information to the guide displaysetting part 8112 to give an instruction on the inclination guidedisplay thereto.

FIGS. 79A and 79B are diagrams showing how the display device 8106provides the inclination guide display. As described above, theinclination (the threshold voltage for the sensor output) at which theinclination guide display is turned on or off changes between thescenery image pickup mode and the other image pickup modes. This makesit possible to make the range within which the inclination guide displayis turned off narrower in the scenery image pickup mode (FIG. 79A) thanin the other image pickup modes (FIG. 79B). Consequently, in the sceneryimage pickup mode, the user can more quickly determine that the videocamera 8100 is inclined.

Next, description will be given of an example in which the thresholdvoltage for the sensor output at which the inclination guide display isprovided is determined. The scenery image pickup mode is a setting modefor which exposure control is set to offer a large depth of field sothat sharp images can be picked up for near views and distant views.Thus, the exposure control is mainly performed with a narrow aperture.Further, in the scenery image pickup mode, image pickup is oftenperformed with a wider angle of view. Thus, the threshold voltage may beset equal to a sensor output voltage for turning on the inclinationguide display at a small inclination when the focal length correspondsto a wide-angle side relative to a predetermined focal length (forexample, half of the focal length of the lens unit) and when theaperture value is equal to or larger than a predetermined aperture value(for example, F8).

As described above, when the inclination guide display showing theinclination of the video camera 8100 is provided on the display device8106, the inclination at which the guide display is turned on or offchanges between the scenery image pickup mode and the other image pickupmodes. In particular, for image pickup in the scenery image pickup mode,in which a wide angle of view, with which the inclination of the videocamera is more noticeable, is often used for image pickup, theinclination at which the inclination guide display is turned on or offis set smaller. This enables the user to be quickly noticed of theinclination of the camera and also enables an increase in horizontalaccuracy. On the other hand, for the sports image pickup mode or theportrait image pickup mode, in which a wide angle of view isinfrequently used, the guide display is not provided unless the camerais steeply inclined. This reduces the complicatedness of the imagemonitored during image pickup.

Embodiment 26

Embodiment 26 of the present invention will be described. Theconfiguration of a video camera that is Embodiment 26 is similar to thatin Embodiment 25 and will not be described below in detail.

FIG. 80 is a flowchart illustrating the processing operation performedby the video camera 8100 of Embodiment 26. In step S8501, the camerasystem controlling microcomputer 8109 loads the inclination information.In step S8502, the camera system controlling microcomputer 8109determines whether or not the current inclination of the video camera8100 is equal to or larger than the set value α. If the inclination isequal to or larger than the set value α, the process proceeds to stepS8503 to turn on the inclination guide display (the inclination guidedisplay is provided). If the inclination is smaller than the set valueα, the process proceeds to step S8507 to turn off the inclination guidedisplay (the inclination guide display is not provided).

If the inclination guide display is turned on (the inclination guidedisplay is provided) in step S8503, then the camera system controllingmicrocomputer 8109 determines the current setting of the image pickupmode in step S8504. Specifically, the camera system controllingmicrocomputer 8109 determines whether or not the scenery image pickupmode is set.

In step S8504, if the scenery image pickup mode is set, the processproceeds to step S8505 to set the angle of the inclination guide display1.5 times as large as an output value from the inclination sensor 8107in order to increase the level of exaggeration of the inclination guidedisplay. On the other hand, in step S8504, if the scenery image pickupmode is not set, the process proceeds to step S8506 to set the angle ofthe inclination guide display equal to the output value from theinclination sensor 8107.

In step S8608, the camera system controlling microcomputer 8109 outputsthe inclination guide display control information to the guide displaysetting part 8112 to give an instruction on the inclination guidedisplay thereto.

FIGS. 83A and 83B are diagrams showing how the display device 8106provides the inclination guide display. The figure shows that even withthe same inclination of the video camera 8100 to a horizontal position,the inclination guide display is exaggerated so as to show a largerangle in the scenery image pickup mode (FIG. 83B) than in the otherimage pickup modes (FIG. 83A). This enables the user to be warned ofeven a slight inclination of the video camera 8100 in the scenery imagepickup mode.

Thus exaggerating the angle of the inclination guide display in thescenery image pickup mode makes the inclination of the video camera 8100clearer to enable the user to easily recognize the inclination.Exaggerating the inclination guide display in the scenery image pickupmode enables the user to easily recognize a variation in inclinationresulting from a slight movement. This enables the user to easily setthe video camera horizontal.

As described above, in the scenery image pickup mode, the level ofexaggeration of the inclination guide display is set higher than in theother image pickup modes. Thus, in the scenery image pickup mode, inwhich the inclination of a picked-up image is noticeable, the user canbe noticed of the inclination of the video camera 8100 in aneasier-to-understand manner. Moreover, the user can clearly recognizethe inclining displacement amount of the video camera 8100 resultingfrom its slight inclination, so that the user can easily set the videocamera 8100 in the horizontal state. On the other hand, the inclinationguide display is not exaggerated in the sports image pickup mode or theportrait image pickup mode, in which a wide angle of view isinfrequently used. This makes it possible to reduce the complicatednessof the image monitored during image pickup.

Embodiment 27

Embodiment 27 of the present invention will be described. FIG. 81 is ablock diagram showing part of the outlined configuration of a videocamera that is Embodiment 27. The basic configuration of the videocamera is similar to that in Embodiment 25 except that the amplifiercircuit 8108 is replaced with a variable gain amplifier circuit 8601.Components similar to those shown in FIG. 76 are denoted by the samereference numerals and will not be described below in detail.

The variable gain amplifier circuit 8601 changes the gain of the sensoroutput from the inclination sensor 8107 to enable a variation in thedetection sensitivity of the inclination detector constituted by theinclination sensor 8107 and the variable gain amplifier circuit 8601. Again controlling part 8603 provided in a camera system controllingmicrocomputer 8602 changes the gain setting of the variable gainamplifier circuit 8601 depending on the image pickup mode set via theimage pickup mode setting switch 8113.

FIG. 84 is a diagram showing an example of configuration of the variablegain amplifier circuit 8601. The variable gain amplifier circuit 8601 isconstituted by an amplifier 8705, resistors 8706, and a gain switch8704. A switch signal from the camera system controlling microcomputer8602 connects input resistors in parallel with each other with respectto the amplifier 8705 to increase the amplifier gain. The gain ischanged in order to exaggerate the inclination guide display in thescenery image pickup mode.

FIG. 82 is a flowchart illustrating the processing operation performedby the video camera 8100 of Embodiment 27. In step S701, the camerasystem controlling microcomputer 8602 loads the inclination information.In step S8702, the camera system controlling microcomputer 8602determines the current setting of the image pickup mode. Specifically,the camera system controlling microcomputer 8602 determines whether ornot the scenery image pickup mode is set.

In step S8702, if the scenery image pickup mode is set, the processproceeds to step S8703 to check whether or not the sensor sensitivityhas been increased, that is, whether or not the gain of the variablegain amplifier 8601 is set higher. If the sensor sensitivity has notbeen increased, then in step S8708, setting is made to increase thesensor sensitivity.

Then, in S8704, the camera system controlling microcomputer 8602determines whether or not the current inclination of the video camera8100 is equal to or larger than the set value α. If the currentinclination of the video camera 8100 is equal to or larger than the setvalue α, the process proceeds to step S8705 to turn on the inclinationguide display (the inclination guide display is provided). If thecurrent inclination of the video camera 8100 is smaller than the setvalue α, the process proceeds to step S8707 to turn off the inclinationguide display (the inclination guide display is not provided).

On the other hand, in step S8702, if the scenery image pickup mode isnot set, the process proceeds to step S8709 to check whether or not thesensor sensitivity is set at a normal level. If the sensor sensitivityis not set at the normal level, that is, the sensor sensitivity is setfor the scenery image pickup mode, it is changed to the normal level instep S8710. This is an operation for turning off the gain switch 8704 inthe variable gain amplifier circuit 8601.

In step S8704, the camera system controlling microcomputer 8602determines whether or not the current inclination of the video camera8100 is equal to or larger than the set If the inclination is equal toor larger than the set value α, the process proceeds to step S8705 toturn on the inclination guide display (the inclination guide display isprovided). If the inclination is smaller than the set value α, theprocess proceeds to step S8707 to turn off the inclination guide display(the inclination guide display is not provided).

In step S8706, the camera system controlling microcomputer 8602 outputsthe inclination guide display control information to the guide displaysetting part 8112 to give an instruction on the inclination guidedisplay thereto.

As described above, in the scenery image pickup mode, the sensorsensitivity is set higher than in the other image pickup modes. Thus,since the level of exaggeration of the inclination guide display isincreased as in Embodiment 26 in the scenery image pickup mode, in whichthe inclination of a picked-up image is noticeable, the user can benoticed of the inclination of the video camera 8100 in aneasier-to-understand manner. Moreover, the user can clearly recognizethe inclining displacement amount of the video camera 8100 resultingfrom its slight inclination, so that the user can easily set the videocamera 8100 horizontal. On the other hand, the inclination guide displayis not exaggerated in the sports image pickup mode or the portrait imagepickup mode, in which a wide angle of view is infrequently used. Thismakes it possible to reduce the complicatedness of the image monitoredduring image pickup.

Embodiment 28

Embodiment 28 of the present invention will be described. Embodiment 28is a combination of Embodiments 25 and 26, described above. That is, theinclination at which the provision and non-provision of the inclinationguide display are switched is changed between the scenery image pickupmode and the other image pickup modes. The level of exaggeration of theinclination guide display is increased for the scenery image pickupmode. The configuration of a video camera that is Embodiment 28 issimilar to that in Embodiment 25 and will not be described below indetail.

FIG. 85 is a flowchart illustrating the processing operation performedby the video camera 8100 that is Embodiment 28. In step S8001, thecamera system controlling microcomputer 8109 loads the inclinationinformation. In step 8002, the camera system controlling microcomputer8109 determines the current setting of the image pickup mode.Specifically, the camera system controlling microcomputer 8109determines whether or not the scenery image pickup mode is set.

In step S8002, if the scenery image pickup mode is set, the processproceeds to step S8003, where the camera system controllingmicrocomputer 8109 determines whether or not the current inclination ofthe video camera 8100 is equal to or larger than a set value β. If thecurrent inclination of the video camera 8100 is equal to or larger thanthe set value β, the process proceeds to step S8004 to turn on theinclination guide display and further to increase the level ofexaggeration. If the current inclination of the video camera 8100 issmaller than the set value β, the process proceeds to step S8008 to turnoff the inclination guide display.

On the other hand, in step S8002, if the scenery image pickup mode isnot set, the process proceeds to step S8006, where the camera systemcontrolling microcomputer 8109 determines whether or not the currentinclination of the video camera 8100 is equal to or larger than a setvalue α. If the current inclination of the video camera 8100 is equal toor larger than the set value α, the process proceeds to step S8007 toturn on the inclination guide display and to set the level ofexaggeration at the normal value. If the current inclination of thevideo camera 8100 is smaller than the set value α, the process proceedsto step S8008 to turn off the inclination guide display.

Here, the relationship between α and β is:

>(exaggeration coefficient×β).

The exaggeration coefficient indicates the number of times by which theoutput value from the inclination sensor 8107 is increased to set theangle of the inclination guide display. In the present embodiment, theexaggeration coefficient is 1.5 in the scenery image pickup mode.Accordingly, the angles α and β are set so as to satisfy therelationship α>1.5×β. This makes the inclination at which theinclination guide display is turned on or off (the inclination guidedisplay is provided or not provided) always smaller in the scenery imagepickup mode than in the other image pickup modes. Moreover, the level ofexaggeration of the inclination guide display in the scenery imagepickup mode increases as the inclination of the video camera 8100increases.

As described above, the inclination guide display showing theinclination of the video camera 8100 is provided at a smallerinclination in the scenery image pickup mode, in which the inclinationof the video camera 8100 is noticeable. This enables the user to bequickly noticed of the inclination of the video camera 8100 and causesthe actual inclination to be exaggerated when the video camera 8100 issteeply inclined. This in turn makes the inclination of the cameraclearer and enables the user to easily recognize a variation ininclination resulting from a slight movement. The camera can thus beeasily set horizontal, increasing horizontal accuracy.

In Embodiments 25 to 28 described above, the inclination guide displayis changed between the scenery image pickup mode and the other imagepickup modes. The present invention is not limited thereto. For example,the above inclination guide display in the scenery image pickup mode isapplicable to a new green leaves/autumn leaves image pickup modebelonging to the scenery image pickup mode, a firework image pickupmode, in which image pickup is performed in such a dark scene that thehorizon of the scenery cannot be easily determined, and the like.

Embodiment 29

FIG. 86 is a block diagram showing the configuration of a video camerathat is Embodiment 29 of the present invention.

In FIG. 86, reference numeral 9101 denotes an image pickup part in thevideo camera constituted by an image pickup lens, an image pickupelement, a camera signal processing part, and the like to output a videosignal. Reference numeral 9102 denotes a display processing part thatsuperimposes an inclination guide display or the like on the outputvideo signal. Reference numeral 9103 denotes a display device such as anelectronic viewfinder or a liquid crystal panel. Reference numeral 9104denotes an inclination sensor that detects the inclination of the videocamera. Reference numeral 9105 denotes an amplifier that amplifies anoutput from the inclination sensor 9104 to obtain a predetermined outputlevel. Reference numeral 9106 denotes an inclination guide displaycontrolling part which controls, based on inclination information,whether or not to provide the inclination guide display and what displayis to be provided, the inclination guide display controlling part 9106being constituted by a microcomputer or the like.

FIG. 87 is a flowchart of inclination display control performed by theinclination guide display controlling part 9106 in Embodiment 29 of thepresent invention. The operation in Embodiment 29 of the presentinvention will be described below with reference to FIGS. 86 and 87.

First, the inclination information is loaded in S9201. This means that asignal is loaded which is generated by amplifying the output from theinclination sensor 9104 by the amplifier 9105. Then, the processdetermines in S9207 whether or not the inclination guide display iscurrently set on.

If the inclination guide display is not set on (that is, the inclinationguide display is off), the process proceeds to S9203 to determinewhether or not the inclination acquired in S9201 is equal to or largerthan a predetermined angle A. If the inclination is smaller than thepredetermined angle A, no action is taken and the inclination guidedisplay is kept off. Thus, the inclination display is not provided.

On the other hand, if the inclination information acquired in S9201indicates the predetermined angle A or larger, then in S9204, thesetting of the inclination guide display is changed from turn-off toturn-on. Then, in S9205, the display processing part 9102 is instructedto provide the inclination guide display, in accordance with theinclination information acquired in S9201. This operation enables theinclination guide display corresponding to the inclination of the camerato be provided on the display device 9103.

In S9202, if the inclination guide display is currently set on, theprocess proceeds to S9206. In S9206, the process determines whether ornot the inclination acquired in S9201 is equal to or smaller than apredetermined angle B. In S9206, if the process determines that theinclination is equal to or smaller than the predetermined angle B, theprocess proceeds to S9207. The predetermined angles A and B are in therelationship A>B. In S9207, the inclination guide display is turned off.In S9205, the display processing part 9102 is instructed to turn off theinclination guide display. This operation turns off the inclinationguide display provided on the display device 9103.

On the other hand, in S9206, if the process determines that theinclination of the camera is not equal to or smaller than thepredetermined angle B, the inclination guide display is kept on. InS9205, the display processing part 9102 is provided with displayinformation in accordance with the inclination information acquired inS9201. The inclination guide display is thus provided.

FIG. 88 is a diagram showing an example of the inclination guide displayshowing that the camera is inclined counterclockwise. The above displayprocessing part 102 superimposes, on the video signal, a displaycorresponding to the inclination of the camera from a horizontalreference position 9301 not displayed in the display device, to providethe inclination guide display 9302. In FIG. 88, the inclination guidedisplay 9302 is shown by a dashed line, but may be shown by anyconspicuous line such as a solid line or a colored line.

FIG. 89 is a diagram illustrating the relationship between thepredetermined angles A and B for the inclination of the camera, as wellas the inclination guide display. In FIG. 89, even if the setting of theinclination guide display is off, the inclination guide display 9401 isprovided when the inclination of the camera is equal to or larger thanthe predetermined angle A (9402). Further, even if the setting of theinclination guide display is on, the inclination guide display 9403 isnot provided when the inclination of the camera is smaller than thepredetermined angle B (9404).

Accordingly, the predetermined angle B is the lower limit value at whichthe inclination guide display 9403 is provided when the setting of theinclination guide display is on, and the predetermined angle A is thelower limit value at which the inclination guide display 9401 isprovided when the setting of the inclination guide display is off. Ifthe setting of the inclination guide display is on and then theinclination of the camera becomes smaller than the predetermined value B(9404), the inclination guide display is turned from on to off.

Then, when the inclination of the camera becomes equal to thepredetermined angle A (9402), the guide display is provided again. Whenthe inclination of the camera is in the range from the predeterminedangle B (9404) to the predetermined angle A (9402), the inclinationguide display is kept off.

When the setting of the inclination guide display is off, theinclination guide display is turned from on to off by that theinclination of the camera becomes smaller than the predetermined angle B(9404) after becoming equal to or larger than it.

When the inclination of the camera becomes equal to the predeterminedangle A (9402), the guide display is provided again. When theinclination of the camera is in the range from the predetermined angle B(9404) to the predetermined angle A (9402), the inclination guidedisplay is kept off.

Thus, in the present embodiment, the angle at which the inclinationguide display is turned from on to off is different from the angle atwhich the inclination guide display is turned from off to on. This makesit possible to prevent the displayed image from making the user feelcumbersome by that the provision and non-provision of the inclinationguide display change quickly and repeatedly, even with a slightvariation in inclination.

Next, the detection of inclination will be described. The presentembodiment uses an acceleration sensor as the inclination sensor 9104.FIGS. 90A-1 to 90A-3 show the inclination of the video camera 9100. FIG.90A-1 shows that the video camera is inclined counterclockwise by 90°,FIG. 90A-2 shows that the video camera is at the regular position, andFIG. 90A-3 shows that the video camera is inclined clockwise by 90°.Further, FIG. 90B shows the output from the amplifier 9105 obtained forthe inclination of the video camera 9100. The setting of the gain of theamplifier 9105 results in such an output as shown in FIG. 90B for theinclination of the video camera 9100.

As shown in FIG. 90B, when the video camera 9100 is at the regularposition, that is, when the inclination is 0°, the output from theamplifier 9105 is equal to half of a power supply voltage Vcc. Incontrast, as shown in FIG. 90A-1, inclining the video camera 9100counterclockwise by 90° provides a sensor output equal to the powersupply voltage. Conversely, inclining the video camera 9100 clockwise by90° as shown in FIG. 90A-3 provides a sensor output at a GND level. Forthe inclinations between those shown in FIG. 90A-1 and FIG. 90A-3, theamplifier output changes linearly with the inclination as shown in FIG.90B. Accordingly, whether or not a predetermined angle has been reachedcan be determined by setting a predetermined threshold with respect tothe output obtained at the regular position, shown in FIG. 90A-2.

Reversing the direction in which the sensor is mounted reverses thevariation in sensor output voltage when the video camera is inclined,with respect to that shown in FIG. 90B.

As described above, the video camera of the present embodiment can turnon the inclination guide display when the camera is steeply inclined andturn it off when the camera is gently inclined. This enables theinclination of the camera to be easily checked and makes it possible toprevent a picked-up image displayed on the display device from beingcomplicated because of the always provided inclination guide display.Moreover, applying hysteresis to the angle at which the turn-on andturn-off of the inclination guide display are switched, it is possibleto prevent the user from feeling cumbersome owing to the repeatedturn-on and turn-off of the inclination guide display.

Embodiment 30

Next, Embodiment 30 of the present invention will be described. FIG. 92shows the configuration of Embodiment 30. In FIG. 92, the samecomponents as those in FIG. 86 are denoted by the same referencenumerals and will not be described below. In FIG. 92, reference numeral9107 denotes an inclination accuracy switching determining part thatdetermines whether or not to switch the detection accuracy of theinclination of the video camera. Reference numeral 9702 denotes amicrocomputer including the inclination guide display controlling part9106 and the inclination accuracy switching determining part 9107.

The determination of increasing the detection accuracy is made when, forexample, the installation of the video camera on a tripod has beendetected via a switch (not shown), a menu setting or the like, or theuser has set the accuracy to be increased via a switch (not shown). Thehorizontal position is thus detected more accurately. In the presentembodiment, even if the inclination accuracy switching determining part9107 changes the inclination detection accuracy, the complicatedness ofthe displayed image caused by the inclination guide display can beavoided.

FIG. 91 is a flowchart of the inclination display control executed bythe microcomputer 9702 in Embodiment 30. Embodiment 30 of the presentinvention will be described below with reference to FIG. 91.

In FIG. 91, in S9601, the inclination accuracy switching determiningpart 9107 determines whether or not to increase the inclinationdetection accuracy. To increase the detection accuracy, the amplifiergain of the sensor is set higher in S9602. For normal accuracy, theamplifier gain is set to a normal level in S9603. Then, in S9604,predetermined angles A and B are calculated on the basis of aninclination correction value depending on the amplifier gain.

Here, the predetermined angle A is used to turn on the inclinationdisplay. The predetermined angle B is used to turn off the inclinationdisplay. When the amplifier gain for increased accuracy is N times ashigh as the normal one, the predetermined angle B for the increasedaccuracy is calculated by multiplying the predetermined angle B for thenormal accuracy by a coefficient 1/N, and the predetermined angle A forthe increased accuracy is calculated by multiplying the predeterminedangle A for the normal accuracy by a coefficient in the range from 1/Nto 1/1.

For example, when the amplifier gain is doubled, the predetermined angleB is multiplied by 0.5, and the predetermined angle A is multiplied by acoefficient set between 0.5 and 1. The detection accuracy of thehorizontal position is increased in order to enable the accuratedetection of the angle at which the inclination guide display is turnedoff, that is, the angle at which the horizon is determined to bedetected. Accordingly, the predetermined angle B needs to be preciselyset on the basis of the amplifier gain of the sensor.

In contrast, the predetermined angle A is used to notice the user of theinclination of the video camera. Consequently, the predetermined angle Amay be set similarly to the predetermined angle B or may remain at thenormal value.

This correction operation determines the predetermined angles. Theactual detection angle can be precisely set by appropriately increasingthe gain of the inclination sensor. For example, if the minimumresolution is 0.1 (deg) when the gain is at the normal level, doublingthe gain sets the minimum resolution at 0.05 (deg).

Further, the relationship between the sensor amplifier output voltageand the inclination is such that when ¼ Vcc corresponds to 45° at thenormal gain, doubling the gain causes ½ Vcc to correspond to 45°.Accordingly, the inclination resulting from a change in gain can bedetermined by converting the output voltage into an angle on the basisof the sensor gain.

After the settings in S9604, the inclination information is loaded inS9605. This means that a signal is loaded which is generated byamplifying the output from the inclination sensor 9104 by the amplifier9105 as in Embodiment 29. Then, the process determines in S9606 whetheror not the inclination guide display is currently set on.

If the inclination guide display is not set on (that is, the inclinationguide display is off), the process proceeds to S9607 to determinewhether or not the inclination is equal to or larger than thepredetermined angle A. If the inclination is smaller than thepredetermined angle A, no action is taken and the inclination guidedisplay is kept off.

On the other hand, if the inclination acquired in S9605 indicates thepredetermined angle A or larger, then in S9608, the setting of theinclination guide display is turned from off to on. Then, in S9611, thedisplay processing part 9102 is instructed to provide the inclinationguide display, in accordance with the inclination information acquiredin S9605. This operation enables the inclination guide displaycorresponding to the inclination of the camera to be provided on thedisplay device 9103.

In S9606, if the inclination guide display is currently set on, theprocess proceeds to S9609. In S9609, the process determines whether ornot the inclination acquired in S9605 is equal to or smaller than thepredetermined angle B. In S9609, if the process determines that theinclination is equal to or smaller than the predetermined angle B, theprocess proceeds to S9610. The predetermined angles A and B are in therelationship A>B. In S9610, the inclination guide display is turned off.In S9611, the display processing part 9102 is instructed to turn off theinclination guide display. This operation turns off the inclinationguide display provided on the display device 9103.

On the other hand, in S9609, if the process determines that theinclination of the camera is not equal to or smaller than apredetermined angle B, the inclination guide display is kept on. InS9611, the display processing part 102 is provided with displayinformation in accordance with the inclination information acquired inS9605. The inclination guide display is thus provided.

In Embodiment 30, the predetermined angles A and B are modified inaccordance with the amplifier gain, whereas the relationship between Aand B is always A>B as is the case with Embodiment 29.

As described above, in addition to the effects of Embodiment 29, thevideo camera of the present embodiment sets the predetermined angles Aand B in accordance with the amplifier gain for inclination detection.This enables appropriate control to be performed in accordance with thestate of the video camera.

In Embodiments 29 and 30, an acceleration sensor is used for theinclination sensor. However, any sensor may be used which can output asignal corresponding to the inclination of the camera.

Further, all the embodiments have been described taking the case of thevideo camera. However, the present invention is widely applicable toimage pickup apparatuses having a display device such as a viewfinder ora liquid crystal panel, such as video cameras and digital still cameraswhich can record moving images or still images.

Moreover, the preferred embodiments of the present invention have beendescribed. However, the present invention is not limited to theseembodiments, but many variations and modifications may be made to theembodiments without departing from the scope of the claims.

INDUSTRIAL APPLICABILITY

The present invention can provide an image pickup apparatus that canprovide an appropriate inclination guide display in accordance with theimage pickup mode, the aspect ratio of a picked-up image, the shakingstate of the image pickup apparatus, the zoom state, and the like.

1. An image pickup apparatus comprising: an inclination detector whichdetects an inclination of the image pickup apparatus; a displayprocessor for showing on a display device an inclination guide displaycorresponding to a detection output from the inclination detector; amode switcher capable of switches at least between a specificimage-pickup mode which captures plural picked-up image for making asynthesis image in which the plural picked-up images are connectedtogether and another image-pickup mode; and a display controller whichcontrols such that the inclination guide display is provided in thestitch image-pickup mode.
 2. The image pickup apparatus according toclaim 1, wherein the display controller shows the inclination guidedisplay in the specific image-pickup mode and controls so as not to showthe inclination guide display in the other image-pickup mode.
 3. Animage pickup method comprising the steps of: detecting an inclination ofthe image pickup apparatus; showing on a display device an inclinationguide display corresponding to a detection output from the inclinationdetector; switching at least between a specific image-pickup mode whichcaptures plural picked-up image for making a synthesis image in whichthe plural picked-up images are connected together and the otherimage-pickup mode; and controlling display of the inclination guidedisplay depending on whether or not the switched mode is the specificimage-pickup mode.
 4. An image pickup apparatus comprising: animage-pickup mode setter capable of setting any one of a plurality ofmodes including at least a moving image-pickup mode and a stillimage-pickup mode; a display device; an inclination detector whichdetects an inclination amount relate to a reference position of theimage pickup apparatus; a display processor for showing on the displaydevice an inclination guide display based on the inclination amountdetected by the inclination detector; and a display controller whichcontrols display of the inclination guide display depending on whetherthe set image-pickup mode is the still image-pickup mode or the movingimage-pickup mode.
 5. The image pickup apparatus according to claim 4,when the moving image-pickup mode is set, the display controllercontrols so that the inclination guide display is not shown.
 6. Theimage pickup apparatus according to claim 4, while recording a movingimage when the moving image-pickup mode is set, the display controllercontrols so that the picked-up image is shown and the inclination guidedisplay is not shown.
 7. The image pickup apparatus according to claim4, further comprising a detection amount amplifier which amplifies theinclination amount detected by the inclination detector, wherein thedisplay controller changes a gain of the detection amount amplifierdepending to whether the set image-pickup mode is the still image-pickupmode or the moving image-pickup mode, and controls display of theinclination guide display based on the amplified inclination amount. 8.The image pickup apparatus according to claim 7, wherein the displaycontroller, when the still image-pickup mode is set, increases the gainof the detection amount amplifier than that when the moving image-pickupmode is set.
 9. The image pickup apparatus according to claim 4, thedisplay controller changes a display color of the inclination guidedisplay depending on whether the set image-pickup mode is the stillimage-pickup mode or the moving image-pickup mode.
 10. The image pickupapparatus according to claim 4, the display controller changes a displayform of the inclination guide display depending on whether the setimage-pickup mode is the still image-pickup mode or the movingimage-pickup mode.
 11. The image pickup apparatus according to claim 4,further comprising: a filter which removes a high frequency component ofthe inclination amount detected by the inclination detector; and afilter switcher which switches whether or not to perform removal processdue to the filter to the inclination amount detected by the inclinationdetector, wherein the display processor shows the inclination guidedisplay based on any one of the inclination amount detected by theinclination detector and the inclination amount in which a change ofhigh frequency component is removed by the inclination amount detectedby the inclination detector or the filter, wherein the displaycontroller controls display of the inclination guide display byswitching the filter switcher depending on whether the set image-pickupmode is the still image-pickup mode or the moving image-pickup mode. 12.The image pickup apparatus according to claim 11, wherein the displaycontroller, when the moving image-pickup mode is set, switches thefilter switcher so as to perform the removal process by the filter. 13.The image pickup apparatus according to claim 4, wherein the displaycontroller, when the moving image-pickup mode is set, controls to showsthe inclination guide display by reducing a response than that when thestill image-pickup mode is set.
 14. The image pickup apparatus accordingto claim 4, wherein the display processor superimposedly shows theinclination guide display on a picked-up image on the display device.15. A control method of an image pickup apparatus which includes adisplay device and is capable of setting any one of a plurality of modesincluding at least a still image-pickup mode and a moving image-pickupmode, said control method comprising the steps of: detecting inclinationamount relative to a reference position of the image-pickup apparatus;and controlling display of an inclination guide display depending onwhether a set image-pickup mode is the still image-pickup mode or themoving image-pickup mode, along with a process for showing on thedisplay device the inclination guide display based on the inclinationamount detected by said detecting step.
 16. A non-transitory computerreadable medium configured to store a program to enable a computer toexecute a method for controlling an image pickup apparatus whichincludes a display device and is capable of setting any one of aplurality of modes including at least a still image-pickup mode and amoving image-pickup mode, the method comprising the steps of: detectinginclination amount relative to a reference position of the image-pickupapparatus; and controlling display of an inclination guide displaydepending on whether a set image-pickup mode is the still image-pickupmode or the moving image-pickup mode, along with a process for showingon the display device the inclination guide display based on theinclination amount detected by said detecting step.
 17. An image pickupapparatus comprising: an image-pickup mode setter which sets oneimage-pickup mode in a plurality of image-pickup modes for each specificimage-pickup scene in which a control for picking-up images ispreliminary set depending on the specific image-pickup scene; aninclination detector which detects an inclination of the image-pickupapparatus; a display processor for showing, on a display device, aninclination guide display depending on the inclination detected by theinclination detector; and a display controller which controls display ofthe inclination guide display in accordance with an image-pickup modefor the specific image-pickup scene, which is set by the image-pickupmode setter.
 18. The image pickup apparatus according to claim 17,wherein the plurality of image-pickup mode for each specificimage-pickup scene includes at least one of a scenery image-pickup mode,a portrait image-pickup mode, a sports image-pickup mode, a new greenleaves/autumn leaves image-pickup mode and a firework image-pickup mode.19. The image pickup apparatus according to claim 18, wherein thedisplay controller performs different controls between when theimage-pickup mode for the specific image-pickup scene set by theimage-pickup mode setter is the scenery image-pickup mode and is theportrait image-pickup mode.
 20. The image pickup apparatus according toclaim 17, wherein the display controller changes an inclination at whichthe inclination guide display is switched between a display and anon-display in accordance with the image-pickup mode for the specificimage-pickup scene set by the image-pickup mode setter along withswitching between the display and the non-display of the inclinationguide display in accordance with the inclination set by the inclinationdetector.
 21. The image pickup apparatus according to claim 20, wherein,when the image pickup mode setter sets a specific image pickup mode forthe specific image-pickup scene, the display controller sets theinclination at which the inclination guide display is switched betweenthe display and the non-display and which is smaller than that when theimage-pickup mode setter sets another image-pickup mode.
 22. The imagepickup apparatus according to claim 17, wherein the display processor iscapable of showing an inclination guide display exaggerating theinclination detected by the inclination detector, on the display device,and wherein the display controller changes the level of exaggeration ofthe inclination guide display in accordance with the image-pickup modefor the specific image-pickup scene set by the image-pickup mode setter.23. The image pickup apparatus according to claim 22, wherein, when theimage pickup mode setter sets a specific image pickup mode for thespecific image pickup scene, the display controller increases the levelof exaggeration of the inclination guide display.
 24. An image pickupapparatus comprising: an image-pickup mode setter which sets oneimage-pickup mode in a plurality of image-pickup modes for each specificimage-pickup scene in which a control for picking-up images ispreliminary set depending on the specific image-pickup scene; aninclination detector which detects an inclination of the image-pickupapparatus; a display processor for showing, on a display device, aninclination guide display depending on the inclination detected by theinclination detector; and a detection sensitivity changer which changesa detection sensitivity of the inclination detector in accordance withthe image-pickup mode set by the image-pickup setter.
 25. The imagepickup apparatus according to claim 24, wherein, when the image-pickupmode setter sets a specific image pickup mode for the specific imagepickup scene, the detection sensitivity changer increases the detectionsensitivity of the inclination detector.
 26. The image pickup apparatusaccording to claim 25, wherein the specific image-pickup mode configuresa setting appropriate for picking-up a scenery image.
 27. A controlmethod of an image pickup apparatus, the image pickup apparatusincluding an image-pickup mode setter which sets one image-pickup modein a plurality of image-pickup modes for each specific image-pickupscene in which a control for picking-up images is preliminary setdepending on the specific image-pickup scene, an inclination detectorwhich detects an inclination of the image-pickup apparatus, and adisplay processor for showing on a display an inclination guide displaydepending on the inclination detected by the inclination detector, andthe control method comprising the step of controlling display of theinclination guide display depending on an image-pickup mode for thespecific image-pickup scene set by the image-pickup mode setter.
 28. Acontrol method of an image pickup apparatus, the image pickup apparatusincluding an image-pickup mode setter which sets one image-pickup modein a plurality of image-pickup modes for each specific image-pickupscene in which a control for picking-up images is preliminary setdepending on the specific image-pickup scene, an inclination detectorwhich detects an inclination of the image-pickup apparatus, and adisplay processor for showing on a display an inclination guide displaydepending on the inclination detected by the inclination detector, andthe control method comprising the step of changing detection sensitivityof the inclination guide display depending on an image-pickup mode forthe specific image-pickup scene set by the image-pickup mode setter. 29.A non-transitory computer readable medium configured to store a programto enable a computer to execute a method of an image pickup apparatus,the image pickup apparatus including an image-pickup mode setter whichsets one image-pickup mode in a plurality of image-pickup modes for eachspecific image-pickup scene in which a control for picking-up images ispreliminary set depending on the specific image-pickup scene, aninclination detector which detects an inclination of the image-pickupapparatus, and a display processor for showing on a display aninclination guide display depending on the inclination detected by theinclination detector, and the method of the image pickup apparatuscomprising the step of controlling display of the inclination guidedisplay depending on an image-pickup mode for the specific image-pickupscene set by the image-pickup mode setter.
 30. A non-transitory computerreadable medium configured to store a program to enable a computer toexecute a method of an image pickup apparatus, the image pickupapparatus including an image-pickup mode setter which sets oneimage-pickup mode in a plurality of image-pickup modes for each specificimage-pickup scene in which a control for picking-up images ispreliminary set depending on the specific image-pickup scene, aninclination detector which detects an inclination of the image-pickupapparatus, and a display processor for showing on a display aninclination guide display depending on the inclination detected by theinclination detector, and the method of the image pickup apparatuscomprising the step of controlling display of the inclination guidedisplay depending on an image-pickup mode for the specific image-pickupscene set by the image-pickup mode setter.